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(54) Device control apparatus and method of determining device 



(57) A correlation element 1 34 correlates a source 
device with a destination device according to an instruc- 
tion given by the user. A decision element 122 deter- 
mines whether or not a certain combination of device 
classes is operable as a composite device. In the case 
of the affirmative answer, a determination element 136 
identifies the type of the composite device and specifies 
a user interface for operating the composite device. A 
data output element 132 then displays the specified 
user interface in a window on a monitor 170 at a specific 
timing. This an^angement effectively improves the oper- 
atability of the device control. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention relates to a technique for 
controlling devices. 

Description of the Related Art 

[0002] In a prior art technique, for example, in a state 
that a computer is connected to a scanner and a printer, 
a specific applications program is run on the computer 
to read image data with the scanner and print the Input 
image data with the printer, so as to enable functions 
like a copying machine. 

[0003] With regard to the combination of predeter- 
mined devices (the scanner and the printer in the above 
example), the prior art technique enables one device to 
receive and process the data transmitted from the other 
device under the specific applications program. With 
regard to the combination of arbitrary devices, on the 
other hand, there is no guarantee that one device can 
receive and process the data transmitted from the other 
device. In some cases, effective data transfer is accord- 
ingly not allowable between these art>itrary devices. 
[0004] The prior art technique causes different user 
interfaces for the respective devices to be displayed 
separately in the process of performing the data transfer 
between these devices. This configuration forces the 
user to separately specify instructions on the different 
user interfaces, thereby undesirably worsening the 
operatability. 

[0005] In one exemplified configuration, it is assumed 
that a certain device is connected to one computer and 
another device is connected to another computer, 
among a plurality of computers connecting with one 
another via a network. In this configuration, the prior art 
technique makes it rather difficult to transfer data 
between the certain device and the another device 
according to an applications program, which is activated 
by still another computer, since these computers are 
connected to one another via the network. 

SUMMARY OF THE INVENTION 

[0006] The object of the present invention is thus to 
provide a device control system that enables effective 
data transfer between arbitrary devices and provides a 
user with optimized operatability with respect to any 
combination of devices. 

[0007] At least part of the above and the other related 
objects is attained by a device control apparatus that 
enables control of a source device, which is a transmit- 
ter of data, and a destination device, which is a receiver 
of data. The device control apparatus includes: a device 
specification unit that spedfies a source device and a 



destination device; and a decision unit that determines 
whether or not the specified destination device can 
receive and process data transmitted from the specified 
source device, based on attribute information of the 
5 specified source device and the specified destination 
device. 

[0008] The present invention is also directed to a 
device control system including a source device, which 
is a transmitter of data, a destination device, which is a 

10 receiver of data, and a device control apparatus that 
enables control of the source device and the destination 
device. The device control apparatus includes: a device 
specification unit that specifies a source device and a 
destination device; and a decision unit that determines 

15 whether or not the specified destination device can 
receive and process data transmitted from, the speci- 
fied source device, based on attribute information of the 
specified source device and the specified destination 
device. 

20 [0009] The present invention is further directed to a 
method of determining a combination of a source 
device, which is a transmitter of data, with a destination 
device, which is a receiver of data. The method includes 
the steps of: (a) specifying a source device and a desti- 
25 nation device; and (b) determining whether or not the 
specified destination device can receive and process 
data transmitted from the specified source device, 
based on attribute information of the specified source 
device and the specified destination device. 

30 [001 0] As described above, in the device control appa- 
ratus, the device control system, and the method of 
determining a combination of devices according to the 
present invention, the process first specifies the source 
device and the destination device and subsequently 

35 determines whether or not the specified destination 
device can receive and process the data transmitted 
from the specified source device, based on the attribute 
information of the specified source device and the spec- 
ified destination device. 

40 [0011] In the specification hereof, the devices include 
not only physical devices but part of the functions of the 
physical devices, those having the equivalent functions 
to the physical devices by the software, and those han- 
dled equivalently to the physical devices. The physical 

45 devices include a scanner, a printer, a digital camera, a • 
facsimile, a copying machine, and a variety of other 
computer peripheral equipment. The part of the func- 
tions of the physical devices include, for example, an 
external presentation of only the facsimile function of a 

50 multi-functional color copying machine. Those having 
the equivalent functions to the physical devices and 
those handled equivalently to the physical devices 
include, for example, electronic mail, image processing, 
a processing server, and an applications server. The 

55 applications server means that, for example, when an 
applications program automatically retrieves an image 
file included in a cache directory of Web browser, the 
applications program itself functions as a stationary 
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image input device, such as a digital camera. In this 
case, the device does not have any physical entity. 
[0012] In this specification, a device that enables at 
least transmission of data is defined as the source 
device, and a device that enables at least receipt of data 
is defined as the destination device. If a device for the 
intermediate processing enables jat least transmission 
of data, the device can be regarded as the source 
device. If the device for the Intermediate processing 
enables at least receipt of data, the same device can be 
regarded as the destination device. Namely any of such 
devices can be regarded as either the source device or 
the destination device. 

[001 3] In the description hereof, the specification of 
the source device and the destination device may be 
implemented by first specifying a certain group includ- 
ing a plurality of devices as possible candidates of at 
least either of the source device and the destination 
device and subsequently specifying at least either of a 
source device and a destination device in the certain 
group. Another possible procedure sequentially speci- 
fies at least either of source devices and destination 
devices in a certain group including a plurality of 
devices as possible candidates, 

[0014] The device specification unit may specify the 
source device and the destination device according to 
an instruction given by a user or another apparatus, or 
automatically specify the source device and the destina- 
tion device by a preset method. 

[0015] The technique of the present invention carries 
out the determination for the combination of arbitrary 
devices and, in response to the affirmative result of the 
determination, guarantees that the destination device 
can receive and process the data transmitted from the 
source device. This accordingly ensures the effective 
data transfer between these arbitrary devices. 
[0016] In accordance with one preferable application 
of the present invention, the device control apparatus 
further includes a user interface specification unit that, 
when the decision unit determines that the specified 
destination device can receive and process data trans- 
mitted from the specified source device, specifies a user 
interface for operating a composite device, which has 
both at least part of functions of the specified source 
device and at least part of functions of the specified 
destination device, as a user interface for operating both 
the specified source device and the specified destina- 
tion device; and a display control unit that causes the 
user interface specified by the user interface specifica- 
tion unit to be displayed on a display unit. 
[0017] In a similar manner, in accordance with one 
preferable application of the present invention, the 
method further includes the steps of: (c) when it is 
determined in the step (b) that the specified destination 
device can receive and process data transmitted from 
the specified source device, specifying a user interface 
for operating a composite device, which has both at 
least part of functions of the specified source device 



4 

and at least part of functions of the specified destination 
device, as a user interface for operating both the speci- 
fied source device and the specified destination device: 
and (d) causing the user interface specified in the step 

5 (c) to be displayed. 

[0018] In this specification, the term 'operating the 
device' implies not only operations of the device in a 
narrow sense but settings, controls, and other proc- 
esses of the device. 

10 [001 9] In the arrangement discussed above, for exam- 
ple, in the case of data transfer from the source device 
to the destination device, a user interface for operating 
a composite device having both at least parts of the 
respective functions of the source device and the desti- 

15 nation device is displayed as the user interface for oper- 
ating both the source device and the destination device. 
This arrangement does not require the user to manipu- 
late different user interfaces for the source device and 
the destination device, but enables the user to specify 

20 settings simultaneously in a united user interface. This 
accordingly provides the user with the optimized operat- 
ability with respect to any combination of devices. The 
user can regard the separate devices (that is, the 
source device and the destination device) as one com- 

25 posite device and integrally operates these separate 
devices. This point also provides the user with the opti- 
mized operatability. 

[0020] In accordance with another preferable applica- 
tion of the present invention, the device control appara- 

30 tus further includes a data transfer execution unit that, 
when the decision unit determines that the specified 
destination device can receive and process data trans- 
mitted from the specified source device, controls the 
specified source device and the specified destination 

35 device, in order to enable data to be transferred from the 
specified source device to the specified destination 
device via the device control apparatus. 
[0021 ] In a similar manner, in accordance with another 
preferable application of the present invention, the 

40 method further includes the step of: (c) when it is deter- 
mined in the step (b) that the specified destination 
device can receive and process data transmitted from 
the specified source device, controlling the specified 
source device and the specified destination device, in 

45 order to enable data to be transferred from the specified 
source device to the specified destination device via a 
device coritrol apparatus that enables control of the 
source device and the destination device. 
[0022] This arrangement enables the effective data 

so transfer to be actually performed from the specified 
source device to the specified destination device. 
[0023] In accordance with still another preferable 
application of the present invention, the device control 
apparatus further includes a data transfer execution unit 

55 that, when the decision unit determines that the speci- 
fied destination device can receive and process data 
transmitted from the specified source device, controls 
the specified source device and the specified destina- 
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tion device in order to enable data to be transferred from 
the specified source device to the specified destination 
device not via the device control apparatus. 
[0024] In a similar manner, in accordance with still 
another preferable application of the present invention, s 
the method further includes the step of: (c) when it is 
determined in the step (b) that the specified destination 
device can receive and process data transmitted from 
the specified source device, controlling the specified 
source device and the specified destination device, in io 
order to enable data to be transferred from the specified 
source device to the specified destination device not via 
a device control apparatus that enables control of the 
source device and the destination device. 
[0025] The transmission of data from the specified is 
source device to the specified destination device not via 
the device control apparatus attains the higher-speed 
data transfer. 

[0026] In accordance with another preferable applica- 
tion of the device control apparatus, the device specifi- 20 
cation unit specifies the source device and the 
destination device, when a predetermined operation is 
performed with respect to both a symbol corresponding 
to the source device and a symbol corresponding to the 
destination device while both the symbols are displayed 25 
on a display unit. 

[0027] In a similar manner, in accordance with another 
preferable application of the method, the step (a) 
includes the steps of: (a-l) causing a symbol corre- 
sponding to the source device and a symbol corre- 30 
spending to the destination device to be displayed; and 
(a-2) when a predetermined operation is performed with 
respect to both the symbols, specifying the source 
device and the destination device. 

[0028] The predetermined operation performed with 35 
respect to both the symbols shows that the user desires 
to specify the devices corresponding to these symbols. 
The source device and the destination device are 
accordingly specified in response to the user's require- 
ment. The predetermined operation of the symbols may 4o 
lay one symbol upon the other or select both the sym- 
bols and give a specific command. 
[0029] The present invention is also directed to a com- 
puter program product for determining a combination of 
a source device, which is a transmitter of data, with a 45 
destination device, which is a receiver of data. The com- 
puter program product includes: a computer readable 
recording medium; a first program code that causes a 
computer to specify a source device and a destination 
device; and a second program code that causes the so 
computer to determine whether or not the specified des- 
tination device can receive and process data transmit- 
ted from the specified source device, leased on attribute 
information of the specified source device and the spec- 
ified destination device, wherein the respective program 55 
codes are recorded in the computer readable recording 
medium. 

[0030] The present invention is further directed to a 



data signal that is embodied in a carrier and represents 
a computer program for determining a combination of a 
source device, which is a transmitter of data, with a des- 
tination device, which is a receiver of data. The data sig- 
nal includes: a first program code that causes a 
computer to specify a source device and a destination 
device; and a second program code that causes the 
computer to determine whether or not the specified des- 
tination device can receive and process data transmit- 
ted from the specified source device, based on attribute 
information of the specified source device and the spec- 
ified destination device. 

[0031 ] The computer execUes the computer program 
to generate the device specification unit and the deci- 
sion unit included in the device control apparatus, 
thereby exerting the same effects as those of the device 
control apparatus discussed above. 
[0032] The principle of the present invention can be 
realized by a variety of applications, for example, a 
device control apparatus, a device control system, a 
method of determining a combination of devices, a com- 
puter program for constructing the device control sys- 
tem, a recording medium in which the computer 
program is recorded, and a data signal that includes the 
computer program and is embodied in a carrier. 
[0033] These and other objects, features, aspects, 
and advantages of the present invention will become 
more apparent from the following detailed description of 
the preferred embodiment with the accompanying draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0034] 

Fig. 1 is a block diagram Illustrating the structure of 
a device control system embodying the present 
invention; 

Rgs. 2A through 2C are block diagrams showing 
typical states of connection in the device control 
system of Fig. I; 

Rgs. 3A through 3C are block diagrams shewing 
other available states of connection in the oevice 
control system of Fig. 1 ; 

Fig. 4 is a block diagram showing a different data 
transfer technique applicable to the device control 
system of Fig. T; 

Fig. 5 is a block diagram showing the different data 
transfer technique applicable to the device control 
system of Fig. 1; 

Rg. 6 is a block diagram illustrating a concrete 
example where the COM technology is applied to 
realize the device control system shown in Fig. 1 ; 
Rgs. 7 A and 7B show an operation of a scanner 
icon and a printer icon displayed in a window; 
Rg. 8 shows a process of data transfer carried out 
in the device control system of Fig. 6; 
Rg. 9 shows the process of data transfer carried 
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out in the device control system of Fig. 6; 

Fig. 10 shows the process of data transfer carried 

out in the device control system of Fig. 6; 

Fig. 11 shows the process of data transfer carried 

out in the device control system of Fig. 6; s 

Fig. 12 shows the process of data transfer carried 

out in the device control system of Fig. 6 ; 

Fig. 13 is a block diagram illustrating a concrete 

example where the COM technology is applied to 

realize the data transfer technique shown in Fig. 5; io 

Fig. 14 shows a process of direct data transfer 

between the device controllers 30a and 30b shown 

in Fig. 13; 

Fig. 15 shows the process of direct data transfer 
between the device controllers 30a and 30b shown is 
in Fig. 13; 

Fig. 16 shows the process of direct data transfer 
between the device controllers 30a and 30b shown 
in Fig. 13; 

Fig. 17 shows the process of direct data transfer 20 
between the device controllers 30a and 30b shown 
in Fig. 13; 

Fig. 18 shows an example of a user interface dis- 
played in a window when a virtual copying machine 
is realized by the device control system shown in 25 
Fig. V. 

Fig. 19 shows a flow of data when the virtual copy- 
ing machine is realized by the device control sys- 
tem shown in Fig. 1; 

Fig. 20 shows an example of a device selection tree 30 
displayed in a window; 

Fig. 21 is a block diagram illustrating a device con- 
trol system in the state of connection shown in Fig. 
2C: 

Fig. 22 is a block diagram showing a hardware con- 35 
figuration of the computer 100 shown in Fig. 21 ; 
Fig. 23 shows a scanner icon and a printer icon dis- 
played in the window on the monitor 170 of Fig. 21 ; 
Fig. 24 is a flowchart showing a data transfer start- 
ing routine executed by the interface unit 120 40 
shown In Fig. 21; 

Fig. 25 is a flowchart showing a user Interface dis- 
play routine executed by the interface unit 120 
shown in Fig. 21; 

Fig. 26 shows a user interface for operating a copy- 45 

ing machine as a composite device displayed in the 

window on the monitor 1 70 of Fig. 2 1; 

Fig. 27 shows another user interface for operating a 

receiver facsimile as a composite device displayed 

In the window on the monitor 1 70 of Rg. 21 ; so 

Fig. 28 is a flowchart showing a modification of the 

user interface display routine of Rg. 25: 

Fig. 29 shows a copying machine icon displayed in 

the window on the monitor 170 of Fig. 21; 

Fig. 30 shows a pop-up menu displayed In the vicin- 55 

ity of the printer icon in the window on the monitor 

170 by utilizing the information of accumulated 

results 131 shown In Fig. 21; 



Fig. 31 shows possible combinations of the source 
device and the destination device displayed in a 
window on the monitor 170 by utilizing the informa- 
tion of accumulated results 131 shown in Fig. 21; 
Fig. 32 shows a pop-up menu displayed in the vicin- 
ity of the copying machine icon in the window on the 
monitor 170 by utilizing the information of accumu- 
lated results 131 shown in Fig. 21 ; 
Rg. 33 shows image icons and the printer icon dis- 
played in the window on the monitor 1 70 shown in 
Rg- 21; 

Rg. 34 is a block diagram showing a configuration 
in the case that an Instruction is given to the appli- 
cation unit 110 of the computer 100 by utilizing an 
information terminal 500; 

Fig. 35 shows the appearance of the information 
terminal 500 shown in Fig. 34 and an exemplified 
window displayed in a display unit 530 of the infor- 
mation terminal 500; and 

Rg. 36 is a flowchart showing another user inter- 
face display routine executed by the interface unit 
120 shown in Fig. 21 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0035] Fig. 1 is a block diagram illustrating the struc- 
ture of a device control system embodying the present 
invention. 

[0036] In the illustrated embodiment of Fig. 1 , a variety 
of devices 34a and 34b are objects to be controlled and 
may be. for example, a scanner and a printer. An appli- 
cation unit 20 is constructed by preset applications pro- 
grams and controls the variety of terminal devices 34a 
and 34b via several lower constituents including inter- 
face units 22a and 22b. which will be discussed later. 
[0037] As shown in Rg. 1 , the device control system 
of this embodiment mainly includes the interface units 
22a and 22b. communications path abstraction units 
24a and 24b, and device abstraction units 28a and 28b. 
These constituents are generated corresponding to the 
respective devices 34a and 34b by computer programs. 
[0038] The device abstraction units 28a and 28b 
transmit information including various pieces of control 
information and data to and from the corresponding 
devices 34a and 34b and carry out abstraction of the 
devices, that is, abstraction of the hardware, vvith 
respect to the upper constituents, such as the interface 
units 22a and 22b and the application unit 20. 
[0039] The device abstraction units 28a and 28b 
include device controllers 30a and 30b and device driv- 
ers 32a and 32b. respectively. The device drivers 32a 
arxl 32b apparently remove a difference in control pro- 
cedure between the corresponding devices 34a and 
34b. which is ascribed to the specific characteristics of 
the corresponding devices 34a and 34b. and carry out 
abstraction for the upper constituents, respectively. 
There are. however, still a difference in control proce- 
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dure that is ascribed to a device class or device type. 
[0040] By way of example, when both a printer A man- 
ufactured by a company A and a printer B manufactured 
by another company 8, which are provided as the 
devices in this embodiment, belong to the same device s 
class, that Is, the printer class, the device driver appar- 
ently removes a difference In control procedure 
between the printers A and B and causes both the print- 
ers A and B to be recognized as the similar devices 
included in the common device class (printer class) by io 
the upper constituerrts, such as the device controllers 
30a and 30b. 

[0041] A general printer driver for Windows (trade- 
mark by Microsoft Corporation) is designed to show the 
Windows GDI (graphics device interface) function out- is 
side the printer driver. When a general instruction, such 
as 'Print a specific letter at a certain position*, is input, 
the printer driver converts the instruction into a series of 
commands peculiar to the corresponding printer and 
outputs the series of commands to the corresponding so 
printer for the purpose of controlling the printer. Applica- 
tion of such printer drivers to the device drivers of this 
embodiment enables substantially complete removal of 
a difference in control procedure between the printers, 
which is ascribed to the specific characteristics of the 25 
respective printers. 

[0042] The device controllers 30a and 30b, on the 
other hand, apparently remove a difference In control 
procedure, which Is ascribed to the device class, with 
respect to the corresponding devices 34a and 34b and 
carry out complete abstraction of the respective devices 
34a and 34b for the upper constituents, such as the 
interface units 22a and 22b. 

[0043] As described above, the device drivers 32a and 
32b apparently remove the difference in control proce- 
dure between the devices that belong to the same 
device class, but there is still a difference in control pro- 
cedure between the device belonging to the printer 
class and the device belonging to the scanner class. 
The device controllers 30a and 30b then apparently 
remove a difference in control procedure, which is 
ascribed to the different device classes. This arrange- 
ment enables the upper constituents to recognize the 
different devices, which belong to the different device 
classes, as identical devices with respect to the control 45 
procedure. 

[0044] The respective device controllers 30a and 30b 
provide the upper constituents, such as the interface 
units 22a and 22b. with identical interfaces and carry 
out complete abstraction of the devices. so 
[0045] In one simple example, the following functions 
may be attained by the common interfaces or general- 
purpose interfaces: 

outputting data (data stream, data type) 55 
inputting data (data stream, data type) 
obtaining device state (state ID, state value) 
setting device state (state ID, state value) 



obtaining device attribute (attribute ID, attribute 
value) 

setting device attribute (attribute ID, attribute value) 

Examples of parameters are given in the parentheses. 

[0046] Standardizing the interface to the upper con- 
stituents by each device controller naturally causes 
some device classes to be under meaningless controls 
(functions). The upper constituents, however, can spec- 
ify the adequate controls for each device by examining 
the properties of each device In advance. 
[0047] The device drivers 32a and 32b are provided 
respectively corresponding tc tne devices 34a and 34b 
as mentioned above. It is, however, not necessary to 
provide the device controllers corresponding to the 
respective devices, but is sufficient to provide the device 
controllers corresponding to specific device classes. 
[0048] The interface units 22a and 22b transmit infor- 
mation including various pieces of control informe m 
and data to and from the application unit 20 and the . jr- 
responding device abstraction units 28a and 28b. while 
providing the upper application unit 20 with identical 
interfaces. The various pieces of control information and 
other information are also transmitted between the 
interface units 22a and 22b. The interface units 22a and 
22b also have the function of displaying icons, which 
represent the con-esponding devices 34a and 34b in an 
abstract manner, in a window on display means (not 
30 shown). 

[0049] In the device control system of this embodi- 
ment, there are boundaries, as shown by the one-dot 
chain lines in Fig. 1, between the interface unit 22a and 
the device abstraction unit 28a. between the interface 
35 unit 22b and the device abstraction unit 28b, and 
between the device abstraction units 28a and 28b. In 
general, process boundaries are present in one identi- 
cal computer, whereas network boundaries are present 
between different computers. Each of the boundaries 
shown by the one-dot chain line, represents either the 
process boundary or the network boundary. 
[0050] Figs. 2 and 3 are block diagrams illustrating 
typical examples of connection in the device control sys- 
tem of Fig. 1 . 

[0051 ] In the example of Fig. 2A, the two devices 34a 
and 34b shown in Fig. 1 are directly connected to one 
computer 40. In this configuration, the constituents 
other than the devices 34a and 34b. that is. the applica- 
tion unit 20. the interface units 22a and 22b. the commu- 
nications path abstraction units 24a and 24b. and the 
device abstraction units 28a and 28b shown in Fig. 1 are 
all present in the same computer 40. Ail the boundaries 
shown by the one-dot chain lines in Fig. 1 accordingly 
represent the process boundaries. 
[0052] In the example of Fig. 2B. two computers 42 
and 44 are connected to each other via a network 46, 
and the two devices 34a and 34b are respectively con- 
nected to these two computers 42 and 44. In this conf ig- 
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uration. among the main constituents other than the 
devices 34a and 34b. tiie application unit 20, the inter- 
face units 22a and 22b, and the device abstraction unit 
2da are present in one computer 42. and the device 
abstraction unit 28b is present in the other computer 44. 
Namely the application unit 20, the interface units 22a 
arid 22b, and the device abstraction unit 28a are 
present in the identical computer 42, whereas the 
device abstraction unit 28b is present in the different 
computer 44. The boundary shown by the one-dot chain 
line between the interface unit 22a and the device 
abstraction unit 28a accordingly represents the process 
boundary. The boundaries shown by the one-dot chain 
lines between the interface unit 22b and the device 
abstraction unit 28b and between the device abstraction 
units 28a and 28b, on tiie other hand, represent the net- 
work boundaries. 

[0053] A variety of networks, such as the Internet, an 
Intranet, a local area network (LAN), and a wide area 
network (WAN), may be applicable to the network 46. 
[0054] In the example of Fig. 2C. three computers 48, 
50, and 52 are connected to each other via a network 
54, and the two devices 34a and 34b are respectively 
connected to two of these computers 50 and 52. In this 
configuration, among the main constituents other than 
the devices 34a and 34b, the application unit 20 and the 
interface units 22a and 22b are present in the first com- 
puter 48, the device abstraction unit 28a is present in 
the second computer 50, and the device abstraction unit 
28b is present in the third computer 52. Namely the 
device abstraction units 28a and 28b are present in the 
different computers, which are further different from the 
computer in which the application unit 20 and the inter- 
face units 22a and 22b are present All the boundaries 
shown by the one-dot chain lines in Fig. 1 accordingly 
represent the network boundaries, 
[0055] In the examples of Rg. 2, a variety of comput- 
ers, such as a personal computer, a mobile computer, 
an information processing terminal, and a work station, 
as well as peripheral equipment substantially having the 
computer functions, such as a copying machine and a 
printer, set top boxes substantially having the computer 
functions, such as a receiver terminal of Web TV and 
other information terminals, and game machines may 
be applicable for each of the computers. Although the 
devices are externally connected to the computers in 
the examples of Fig. 2, the devices and the computers 
may be integrally constructed as shown in Fig. 3. 
[0056] In the example of Fig. 3 A. a machine 41 
includes a device unit 34b' and a computer unit 40'. 
Namely the device and the computer are integrated with 
each other. In a similar manner, in the example of Fig. 
3B. a machine 45 includes a device unit 34b' and a com- 
puter unit 44'. In the example of Fig. 3C. a machine 53 
includes a device unit 34b' and a computer unit 52'. In 
any of these examples, the device and the computer are 
integrated with each other. 

[0057] Referring back to Rg. 1. as described previ- 



ously, the process boundaries or the network bounda- 
ries shown by the one-dot chain lines are present 
between the interface unit 22a and the device abstrac- 
tion unit 28a, between the interface unit 22b and the 

5 device abstraction unit 28b, and between the device 
abstraction units 28a and 28b. Communications paths 
26a and 26b are present between the interface unit 22a 
and the device abstraction unit 28a and between the 
interface unit 22b and the device abstraction unit 28b to 

70 connect the interface unit 22a with the device abstrac- 
tion unit 28a and the interface unit 22b with the device 
abstraction unit 28b across these boundaries, respec- 
tively These communications paths 26a and 26b may 
have different types, such as internal buses, communi- 

75 cations interfaces, and network communication means, 
according to whether each of the boundaries is the 
process bourxlary or the network boundary. 
[0058] The communications path abstraction units 
24a and 24b are provided on both ends of the commu- 
te nications paths 26a and 26b between the interface unit 
22a and the device abstraction unit 28a and between 
the interface unit 22b and the device abstraction unit 
28b. respectively. The communications path abstraction 
units 24a and 24b carry out abstraction of the communi- 

25 cations paths 26a and 26b interposed between the 
interface unit 22a and the device abstraction unit 28a 
and between the interface unit 22b and the device 
abstraction unit 28b, white the interface units 22a and 
22b respectively transmit various pieces of control Infor- 

30 mation and data to and from the device abstraction units 
28a and 28b via the communications paths 25a and 26b 
across the process boundary or the network boundary. 
Namely the communications path abstraction units 24a 
and 24b apparently remove a difference in control pro- 

35 cedure. which is ascribed to the different types of the 
interposed communications paths 26a and 25b, and 
enable the interface units 22a and 22b and the device 
abstraction units 28a and 28b to transmit the control 
information and data between each other without taking 

40 into account whether the boundary is the process 
boundary or the network boundary. 
[0059] The constructions of the communications path 
abstraction units 24a and 24b will be described later in 
detail. 

45 [0060] As mentioned above, the interface units 22a 
and 22b. the communications path abstraction units 24a 
and 24b. and the device abstraction units 28a and 28b 
are implemented by the computer programs. In accord- 
ance with a concrete procedure, a CPU in each compu- 

50 ter. where the respective constituents are present, 
reads and executes desired computer programs stored 
in an internal memory, and thereby functions as the con- 
stituents included in the computer. 
[0061] The computer programs stored in the internal 

55 memory may be provided in a form recorded in a 
recording medium, such as a CD-ROM. in a computer 
readable manner as described later. The computer pro- 
grams recorded in the recording medium are read by a 
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reading device, such as a CD-ROM drive, and are trans- 
ferred to and stored into an external storage device, 
such as a hard disk. On the activation of the computer, 
for example, these computer programs are transferred 
to the internal memory according to the requirements. 5 
Alternatively the computer programs read by the read- 
ing device may be transferred to the internal memory 
not via the external storage device but directly 
[0062] Although the CD-ROM is utilized as the 'record- 
ing medium' in which the computer programs are 10 
recorded in the computer readable manner in this 
embodiment, a variety of other computer readable 
media may be used alternatively for example, flexible 
disks, magneto-optic discs, IC cards. ROM cartridges, 
punched cards, prints with barcodes or other codes is 
printed thereon, and internal storage devices (memo- 
ries like a RAM and a ROM) and external storage 
devices of the computer 

[0063] Another possible procedure has access to a 
program server (not shown), which supplies computer so 
programs, via a network and takes the computer pro- 
grams out of the program server into each computer. 
[0064] Part of the computer programs may be con- 
structed as an operating system program. 
[0065] The processing operations of the device con- 25 
trol system shown in Rg. 1 are briefly described. When 
a user of the computer, in which the application unit 20 
and the interface units 22a and 22b are present, inputs 
an instruction for setting the device 34a into the applica- 
tion unit 20 via input means (not shown), such as a key- 30 
board and a mouse, the application unit 20 transmits the 
instruction to the interface unit 22a. The interface unit 
22a further transmits the instruction to the device 
abstraction unit 28a via the communications path 26a. 
The device abstraction unit 28a sets the device 34a 35 
according to the instruction. 

[0066] When the user inputs an instruction for trans- 
ferring data from the device 34a to the device 34b into 
the application unit 20. the application unit 20 transmits 
the instruction to the interface units 22a and 22b. The 40 
interface units 22a and 22b have communication with 
each other according to the instruction and determine 
whether or not effective data transfer is available 
between the devices 34a and 34b. that is, whether or 
not the device 34b can receive and process the data 45 
transmitted from the device 34a. 

[0067] When it is determined that the effective data 
transfer is available, that is, it is determined that the 
device 34b can receive and process the data transmit- 
ted from the device 34a, the interface unit 22a transmits so 
the instruction of data transfer to the device abstraction 
unit 28a via the communications path 26a. The device 
abstraction unit 28a then inputs data from the device 
34a and transmits the data to the interface unit 22a via 
the communications path 26a. The interface unit 22a ss 
further transmits the data to the application unit 20. 
which causes the data to be subjected to predetermined 
processing, calls the interface unit 22b. and transmits 



the processed data to the interface unit 22b. The inter- 
face unit 22b calls the device abstraction unit 28b via 
the communications path 26b and transmits the data to 
the device abstraction unit 28b. The device abstraction 
unit 28b outputs the transmitted data to the device 34b. 
The device 34b causes the input data to be subjected to 
predetermined processing. 

[0068] In Fig. 1. black arrows represent transmission 
of information including various pieces of control Infor- 
mation, while open arrows represent the flow of data 
transferred. 

[0069] A different technique may be applied for the 
data transfer. Figs. 4 and 5 are block diagrams illustrat- 
ing another data transfer technique applicable to the 
device control system of Fig, 1 . Referring to Fig. 4, when 
the user inputs an instruction for transferring data from 
the device 34a to the device 34b into the application unit 
20. the application unit 20 transmits the instruction to 
the interface units 22a and 22b. The interface units 22a 
and 22b have communication with each other according 
to the instruction and determine whether or not effective 
data transfer is available between the devices 34a and 
34b, that is, whether or not the device 34b can receive 
and process the data transmitted from the device 34a. 
[0070] When it is determined that the effective data 
transfer is available, that is. it is determined that the 
device 34b can receive and process the data transmit- 
ted from the device 34a. the interface units 22a and 22b 
transmit the instruction of data transfer to the device 
abstraction units 28a and 28b via the communications 
paths 26a and 26b. As shown in Rg. 5. this cuts of the 
connections between the interface unit 22a and the 
device abstraction unit 28a and between the interface 
unit 22b and the device abstraction unit 28b, and newly 
establishes a connection between the device controller 
30a of the device abstraction unit 28a and the device 
controller 30b of the device abstraction unit 28b via a 
communications path 38. A pair of communications 
path abstraction units 36 are newly generated to carry 
out abstraction of the communications path 38 inter- 
posed between the device abstraction units 28a and 
28b. while the device abstraction units 28a and 28b 
transmit the various pieces of control information and 
data with each other via the communications path 38 
across the process boundary or the network boundary. 
The communications path abstraction units 36 thus 
apparently remove a difference in control procedure, 
which is ascribed to the type of the interposed commu- 
nications path 38, and enable the device abstraction 
units 28a and 28b to transmit the control information 
and data between each other without taking into 
account whether the boundary is the process boundary 
or the network boundary. 

[0071 ] After the connection is established between the 
device abstraction units 28a and 28b. the device 
abstraction unit 28a inputs data from the device 34a. 
calls the device abstraction unit 28b via the communica- 
tions path 38. and transmits the input data to the data 
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abstraction unit 28b. The device abstraction unit 28b 
outputs the transmitted data to the device 34b. The 
device 34b causes the input data to be subjected to pre- 
determined processing. 

[0072] After completion of the data transfer, the proce- 
dure cuts off the connection between the device 
abstraction units 28a and 28b and reestablishes the 
connections between the interface unit 22a and the 
device abstraction unit 28a and between the interface 
unit 22b and the device abstraction unit 28b. 
[0073] In thedata transfer technique described above, 
the communications path 38 bypasses the data transfer 
passage. When the computer system applied has, for 
example, the configuration shown in Fig. 2C or the con- 
figuration shown in Fig. 30, the network boundary inter- 
posed between the device al>straction units 28a and 
28b is accordingly optimized, and the computer 48. in 
which the application unit 20 and the interface units 22a 
arKJ 22b are present, is not at all involved in the data 
transfer. This arrangement ensures the high-speed data 
transfer. 

[0074] As mentioned above, when the user inputs an 
ir^truction for transferring data from the device 34a to 
the device 34b. the interface units 22a and 22b have 
communication with each other according to the instruc- 
tion and determine whether or not effective data transfer 
is available between the devices 34a and 34b. that is. 
whether or not the device 34b can receive and process 
the data transmitted from the device 34a. 
[0075] In accordance with one concrete procedure, 
the interface units 22a and 22b refer to re information of 
devices of interest, that is. the devices 34a and 34b, and 
carry out the determination discussed above. The 
attribute information referred to by the interface units 
22a and 22b includes the type of the device, a piece of 
information for specifying either a source device or a 
destination device, a piece of information for specifying 
either a push type or a pull type (that is. either the 
source side or the destination side is mainly responsible 
for the data transfer), the processible data formats, the 
state of the device (for example, operable or not), the 
performance of the device (for example, the processing 
speed), the location of the device (for example, the sec- 
tion and the floor), the processing cost (for example, the 
communication cost and the printing cost) of the device, 
and the presence or non-presence of a support for a 
special data transfer method. 

[0076] Other than for the purpose of determination, 
the attribute information is also used to obtain an evalu- 
ation value that represents a degree of effectiveness 
with respect to each combination of devices of interest 
as discussed later. 

[0077] The attribute information may be stored in the 
computer where the application unit 20 and the inter- 
face units 22a and 22b are present, or alternatively be 
stored in the computer where the device controller and 
the device driver are present. In the latter case, the 
interface units 22a and 22b establish connections with 



the corresponding device controllers 30a and 30b. have 
comnrtunications with the device controllers 30a and 
30b according to the requirements, refer to the attribute 
information, and carry out the determination regarding 

5 the effective data transfer. The attribute information may 
alternatively be stored in another computer (for exam- 
ple, a server) on the network, which is different from the 
computer where the application unit 20 and the inter- 
face units 22a and 22b are present. In this case, the 

10 interface units 22a and 22b establish connections with 
the server, refer to the attribute information stored in the 
server, and carry out the determination regarding the 
effective data transfer. 

[0078] In the event that data can be transmitted from 

15 one device and received and processed by the other 
device, even if these devices are connected to each 
other via a network, the user may occasionally regard 
these devices as one device. Such a device is referred 
to as the composite device in this specification. The 

20 composite device represents a virtual device having at 
least part of the functions of one device that transmits 
data and at least part of the functions of the other device 
that receives data, out of a plurality of devices of inter- 
est. When the data are transmitted from the device 34a 

25 and received and processed by the device 34b like the 
above example, the devices of interest are the devices 
34a and 34b, The virtual device having at least part of 
the functions of the device 34a and at least part of the 
functions of the device 34b is accordingly regarded as 

30 the composite device. 

[0079] In some combinations of arbitrary devices, 
while one device transmits data, the other device may 
not be able to receive and process the data. In such 
cases, the virtual composite device is inoperable in the 

35 actual state. 

[0080] One of the available techniques thus deter- 
mines whether or not a combination of arbitrary devices 
is operable as the composite device as discussed later, 
so as to determine whether or not one arbitrary device 

40 can receive and process the data transmitted from the 
other arbitrary device 

[0061] The following describes a concrete example 
where a COM (Component Object Model) technique is 
applied to realize the device control system shown in 
45 Fig. 1, 

[0082] The COM is an infrastructure that has been 
proposed and promoted by Microsoft Corporation to 
aggregate objects. The COM defines a method of build- 
ing dynamically exchangeable components and repre: 
so sents a specification of standard component 
architecture. 

[0083] In the COM technique, services provided by 
the software are implemented as COM objects. Each 
COM object supports at least one interface and is iden- 
55 tified by a class ID. In this concrete example, among the 
constituents shown in Fig. 1 , the interface units 22a and 
22b and the device controllers 30a and 30b are con- 
structed as COM objects. 
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[0084] The interface supported by the COM object 
generally Includes a plurality of methods that have some 
relation to one another. Each interface is identified by an 
interface ID. The method Is a function call for executing 
a specific function. A pointer to a specific interface is 
required to call a method included in the specific inter- 
face. The pointer to the specific interface is obtained by 
specifying the interface ID. which identifies the specific 
interface, and the class ID. which identifies the COM 
object that supports the specific interface, and calling a 
service of a COM library. 

[0085] Fig. 6 is a block diagram illustrating a concrete 
example where the COM technology is applied to real- 
ize the device control system shown in Fig. i . 
[0086] Referring to Fig, 6. the application unit 20 func- 
tions according to the applications programs as dis- 
cussed previously and has an event handler N1 
incorporated therein. 

[0087] The interface units 22a and 22b are con- 
stmcted as the COM objects as mentioned above and 
support a plurality of interfaces 11 through 110. In Fig. 6. 
the Interfaces are shown by open circles. Among these 
interfaces. II and 16 are ICyberPlugs. 12 and 17 are 
IContextMenus. 13 and 18 are IDropSources. 14 and 19 
are IDropTargets. and 15 and 110 are ICyberEvents. The 
IContextMenus J2 and I7.the IDropSources 13 and 18 
and the IDropTargets 14 and 19 are general interfaces, 
whereas the ICyberPlugs II and 16 and the ICyberE- 
vents 15 and 110 are original interfaces in this concrete 
example. 

[0088] As described previously, the interface units 22a 
and 22b provide the upper application unit 20 with iden- 
tical interfaces or general-purpose interfaces. The ICy- 
berPlugs II and 16 correspond to the general-purpose 
interfaces. 

[0089] The interface units 22a and 22b support other 
interfaces, such as IDataObjects. as well as the above 
interfaces. 

[0090] The device controllers 30a and 30b are also 
constructed as the COM objects as mentioned above 4o 
and support a plurality of Interfaces in through 114. 
Among these interfaces. Ill and 113 are ICyberProto- 
cols. and 112 and 114 are ICyberEvents. These inter- 
faces 111 through 114 are all original interfaces in this 
concrete exannple. The device controllers 30a and 30b 45 
respectively include status monitors Ml and M2 as 
modules 

[0091 ] As described previously, the device controllers 
30a and 30b provide the upper constituents including 
the interface units 22a and 22b with identical interfaces so 
or general-purpose interfaces, in order to attain the 
complete abstraction of devices. The ICyberProtocols 
111 and 113 correspond to the general-purpose inter- 
faces. 

[0092] The device drivers 32a and 32b and the ss 
devices 34a and 34b in the example of Fig. 6 are identi- 
cal with those in Fig. 1 . 

[0093] In the example of Fig. 6. proxies PI and P2 and 



stubs SI and S2 constitute the communications path 
abstraction unit 24a shown in Fig. 1 . Proxies P3 and P4 
and stubs S3 and S4 constitute the communications 
path abstraction unit 24b. Such proxies and stubs are 
5 generated by the mechanism of COM/DCOM (distrib- 
uted COM). The COM/DCOM is the mechanism nor- 
mally supported by Windows platforms. 
[0094] The following describes the mechanism of 
implementing the abstraction of the communications 
' paths by the functions of the proxies and stubs constitut- 
ing the communications path abstraction units 24a and 
24b. 

[0095] In the COM technique, in the process of calling 
a method included in an interface (hereinafter referred 
to as the interface call), a calling side is referred to as a 
client and a called side is referred to as a server The 
server may work (a) in an identical process (identical 
address space) on the same computer as the client, (b) 
in a different process (different address space) on the 
same computer as the client, or (c) in a process 
(address space) on a different computer from the client. 
[0096] In the case where the boundaries (shown by 
the one-dot chain lines in Fig. 1) interposed between 
the interface unit 22a and the device controller 30a and 
between the interface unit 22b and the device controller 
30b are the process boundaries, the interface units 22a 
and 22b and the device controllers 30a and 30b hold the 
server-client relationship of (b). In the case where these 
boundaries are the network boundaries, on the other 
hand, the interface units 22a and 22b and the device 
controllers 30a and 30b hold the server-client relation- 
ship of (c). 

[0097] In the cases of (b) and (c), the server works in 
a different address space or process from that of the cli- 
ent. It is accordingly impossible to apply a simple call, 
such as a function call, to the interface call. In this con- 
crete example, in order to call an interface realized by 
the server, the client first generates a proxy, which sup- 
ports the identical interface with that of the server, in the 
same process or address space as that of the client, 
and calls the interface via the proxy. The proxy converts 
the interface call by the client into a remote procedure 
call (RPC) or a lightweight remote procedure call 
(LRPC), and calls a stub generated in the same process 
or address space as that of the server. The stub 
restores the remote procedure call or the lightweight 
remote procedure call into the original interface call and 
calls the target interface included in the server. The sub- 
sequent return of the interface call follows the reverse of 
the above procedure. 

[0098] The remote procedure calls is a mechanism for 
calling a function over a network boundary and converts 
the function call into data transmission on the network. 
The remote procedure call is accordingly applied in the 
case of (c). The lightweight remote procedure calls is a 
mechanism for calling a function over a process bound- 
ary on the same computer and implements the function 
call through the inter-process communication. The light- 
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weight remote procedure call is accordingly applied in 
the case of (b). 

[0099] The method of converting the interface call into 
the remote procedure call or the lightweight remote pro- 
cedure call and allowing the transmission between the s 
proxy and the stub apparently removes a difference in 
control procedure, which is scribed to the different types 
of the communications paths, and implements the inter- 
face call without taking into account whether the bound- 
ary is the process boundary or the network boundary. io 
thereby enabling the abstraction of the communications 
paths. 

[01 00] the operation of this concrete procedure is 
described beiow with the drawings of Figs. 6, 7A. and 
7B. In the following description, the device 34a is a is 
scanner and the device 34b is a printer. 
[0101] A scanner as the device 34a and a printer as 
the device 34b are mounted in advance as objects to be 
controlled in a display area of an application by the 
application unit 20. A scanner icon and a printer icon 20 
are displayed in the window on display means (not 
shown), such as a CRT. by the interface units 22a and 
22b as shown in Fig. 7A. This arrangement enables the 
user of the computer where the application unit 20 is 
present to carry out a variety of required operations with 2S 
respect to the scanner ard the printer. 
[0102] It is assumed that the user operates an icon 
displayed in a window with manipulation means (not 
shown), such as a keyboard or a mouse. In the event 
that the operation of the icon by the user specifies set- so 
tings of the scanner, for example, by clicking a right but- 
ton of the mouse on the scanner icon, the application 
unit 20 calls the IContextMenu 12 from the interface unit 
22a corresponding to the scanner or the device 34a. 
The iContextf\/1enu 12 displays a pop-up menu for the 35 
scanner context in the vicinity of the scanner icon and 
has communication with the device controller 30a to 
specify the settings of the scanner as the device 34a in 
response to an option selected among the pop-up menu 
by the user. 

[01 03] In the event that the operation of the icon by the 
user is a drag and drop operation of the icon, the follow- 
ing procedure is carried out. 

[01 04] When the user drags the scanner icon onto the 
printer icon displayed in the window with a mouse cur- 45 
sor as shown in Fig. 7B. the interface unit 22b causes 
the IDropSource 13 supported by the interface unit 22a 
to be transmitted to the IDropTarget 19 supported by the 
interface unit 22b. In accordance with a concrete proce- 
dure, one of the methods included in the IDropTarget 19 so 
is called by using the pointer of the IDropSource 13 as a 
parameter. 

[0105] In the interface unit 22b. the IDropTarget 19 
takes a pointer of the ICyberPlug 11 supported by the 
interface unit 22a out of the transmitted IDropSource 13 ss 
and asks the ICyberPlug 16 supported by the interface 
unit 22b whether the data transfer between the ICyber- 
Plugs 16 and 11 is available. 



[01 06] At this moment, the interface units 22a and 22b 
respectively establish the connections with the corre- 
sponding device controllers 30a and 30b, have commu- 
nications with the device controllers 30a and 30b 
according to the requirements, and determine whether 
or not the data transfer is available. 
[01 07] In the event that the data transfer is available, 
the interface units 22a and 22b set the mouse cursor, 
which is displayed in the window and is being dragged, 
in a first shape representing the permission of the drag 
and drop operation. In the event that the data transfer is 
not available, on the other hand, the interface units 22a 
and 22b set the mouse cursor in a second shape repre- 
senting the prohibition of the drag and drop operation. 
[01 08] In the state that the data transfer is available, 
when the user operates the mouse and drops tfie 
dragged scanner icon upon the printer icon, in the inter- 
face unit 22b, the IDropTarget 19 transmits the ICyber- 
Plug II supported by the interface unit 22a to a method 
of starting data transfer included in the ICyberPlug 16 
and entrusts the actual processing to the ICyberPlug IS. 
[01 09] The actual data transfer is implemented in the 
following manner. When the data transfer is carried out 
via the interface unit 22a. the application unit 20. and 
the interface unit 22b as shown in Rg 1 . the actual data 
transfer follows a procedure shown in Figs. 8 through 
12. When the data transfer is carried out directly 
between the device controllers 30a and 30b as shown in 
Fig. 5. on the other hand, the actual data transfer follows 
a procedure shown in Figs. 13 through 17. 
[0110] Figs. 8 through 12 show a process of data 
transfer in time series in the device control system of 
Fig. 6. In these drawings, the parts that are mainly 
involved in a cun-ently executed step are shown by the 
solid lines, whereas the parts that are hardly involved in 
the currently executed step are shown by the broken 
lines. 

[01 1 1 ] When the data transfer process starts, the data 
obtained from the device 34a (scanner) are input into 
the device driver 32a and stored into a buffer in the 
device driver 32a as shown in Fig. 8. Referring to Rg. 9, 
the status monitor IS/11 in the device controller 30a 
detects the data input and informs the event handler N1 
in the application unit 20 of the detected data input as 
an event via the proxy PI . the stub SI . and the ICyber- 
Event 15 of the interface unit 22a. The application unit 20 
may ignore the informed event or alternatively perform 
the data input immediately in response to the informed 
event. 

[01 12] Referring to Fig. 10. in order to implement the 
data transfer, the application unit first provides a data 
storage area therein and calls the interface unit 22a to 
obtain data (see the solid arrow). This transfers the exe- 
cution of the processing to the interface unit 22a. The 
interface unit 22a then calls the device controller 30a to 
obtain data (see the solid arrows) and generates the 
proxy P2 and the stub S2. The stub S2 provides therein 
a temporary data storage area, which corresponds to 
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the data storage area provided in the application unit 
20, for the device controller 30a and transhiits the tem- 
porary data storage area as a parameter to the device 
controller 30a. This transfers the execution of the 
processing to the device controller 30a. The device con- 5 
troller 30a subsequently calls the device driver 32a to 
obtain data. This transfers the execution of the process- 
ing to the device driver 32a. 

[01 1 3] The device driver 32a copies the data stored in 
the buffer into the data storage area provided in the stub n 
S2. The return of the function call shifts the execution of 
the processing from the device driver 32a to the inter- 
face unit 22a via the device controller 30a. The interface 
unit 22a then copies the data in the data storage area 
provided in the stub S2 into the original data storage u 
area provided in the application unit 20. The return of 
the function call further shifts the execution of the 
processing from the interface unit 22a to the application 
unit 20. 

[0114] The application unit 20 then reads data from 20 
the data storage area provided in the application unit 20 
and causes the input data to be subjected to a specific 
operation according to the requirements. As shown in 
Fig 11. the application unit 20 then calls the interface 
unit 22b to transmit the data (see the solid arrow). This 25 
transfers the execution of the processing to the interface 
unit 22b The interface unit 22b then calls the device 
controller 30b to transmit the data (see the solid arrows) 
and generates the proxy P4 and the stub S4. The stub 
S4 provides therein a temporary data storage area. 30 
which corresponds to the data storage area provided iri 
the application unit 20. for the device controller 30b. The 
data output from the application unit 20 are duplicated in 
the temporary data storage area and transferred as a 
parameter to the device controller 30b- This transfers 35 
the execution of the processing to the device controller 
30b. The device controller 30b subsequently calls the 
device driver 32b to transmit the data. This transfers the 
execution of the processing to the device driver 32b. 
[01 1 5] The device driver 32b copies the data stored in 40 
the data storage area provided in the stub S2 into the 
buffer of the device driver 32b. The return of the function 
call shifts the execution of the processing from the 
device driver 32b to the application unit 20 via the 
device controller 30b and the interface unit 22b, 45 
[0116] Referring to Fig. 12, the device driver 32b out- 
puts the data stored in the buffer to the device 34b 
(printer). 

[0117] In the case of synchronous output, the execu- 
tion of the processing is not transfen-ed to the upper so 
layer until the data output to the device 34b is com- 
pleted. In the case of non-synchronous output, however, 
the execution of the processing is transferred to the 
upper layer before the data output to the device 34b is 
completed. 55 
[0118] When the data transfer is carried out directly 
between the device controllers 30a and 30b as shown in 
Fig. 5. the following procedure is implemented. Fig. 13 



is a block diagram illustrating a concrete example where 
the method of data transfer shown in Fig. 5 is realized 
by the COM technology 

[011 9] As described previously, in the interface unit 
22b. the IDropTarget 19 transmits the ICyberPlug II sup- 
ported by the interface unit 22a to the method of starting 
data transfer included in the ICyberPlug 16 and entrusts 
the actual processing to the ICyberPlug 16. The method 
of starting data transfer included in the ICyberPlug 16 
implements the direct data transfer between the device 
controllers 30a and 3Qb according to the following pro- 
cedure. 

[0120] The ICyberPlug 16 of the interface unit 22b 
gives an instruction to the device controller 30b to start 
the direct data transfer between the device controllers 
30a and 30b, and transmits required pieces of informa- 
tion (at least the class ID of the device corTtroller 30a) for 
generation of the mated device controller 30a to the 
device controller 30b. 

[0121] The device controller 30b generates its own 
clone as well as a clone of the mated device controller 
30a based on the transmitted information. The newly 
generated device controller 30b establishes a connec- 
tion with the newly generated device controller 30a and 
makes an optimum communications path. At this 
moment, the proxies P5 and P6 and the stubs S5 and 
S5 are also generated as the communications path 
abstraction unit 36 shown in Fig. 5. 
[01 22] The device controller 30b then starts the data 
transfer to and from the mated device controller 30a 
according to the specified settings of communication. 
When preset termination conditions are fulfilled, the 
data transfer is concluded and the device controller 30b 
cuts of the connection with the device controller 30a. 
[0123] Figs. 14 through 1 7 show a process of direct 
data transfer between the device controllers 30a and 
30b shown in Fig. 13 in time series. In these drawings, 
the parts that are mainly involved in a currently exe- 
cuted step are shown by the solid lines, whereas the 
parts that are hardly involved in the currently executed 
step are shown by the broken lines. 
[01 24] In the case of the direct data transfer between 
the device controllers 30a and 30b, since neither the 
application unit 20 nor the interface units 22a and 22b 
are involved in the data transfer, the device controllers 
30a and 30b directly perform call of a method, transmis- 
sion of an event, and data transfer. The operations of 
the device controllers 30a and 30b, the device drivers 
32a and 32b, and the devices 34a and 34b are, how- 
ever, similar to those executed in the case of the data 
transfer via the application unit 20 and other elements, 
arxi are not specifically described here. 
[0125] As described above, in this embodiment, the 
application unit 20 controls the devices 34a and 34b via 
the interface units 22a and 22b. the communications 
path abstraction units 24a and 24b. and the device 
abstraction units 28a and 28b. so as to specify the set- 
tings of the devices 34a and 34b and implement the 
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data transfer between the devices 34a and 34b without 
taking into account the types of the devices 34a and 34b 
and the types of the interposed communications paths 
26a and 26b. 

[0126] The following describes a concrete example s 
where the device control system shown in Fig. 1 is 
applied to implement a virtual copying machine, which 
is one of the composite devices discussed previously. 
[0127] It is assumed that the applications programs 
constructing the application unit 20 shown in Fig. 1 are io 
programs for implementing a virtual copying machine 
(these programs are hereinafter referred to as Cyber 
Copy). When the applications programs Cyber Copy are 
executed on a computer (not shown), a scanner, which 
has been registered in advance as a default of a source is 
device, and a printer, which has been registered in 
advance as a default of a destination device, are auto- 
matically selected among possible options. A user inter- 
face like that of the copying machine is displayed in a 
window on display means (not shown) as shown in Fig. 
18. The user clicks a START button J1 after specifying 
the number of copies and other required settings in the 
displayed window with the keyboard or the mouse. This 
establishes a connection via a communications path 
and implements transfer of image data from the scanner 
or source device to the printer or destination device, so 
as to enable operations of the virtual copying machine. 
[0128] In this specification, a device that enables at 
least transmission of data is defined as the source 
device, and a device that enables at least receipt of data 
is defined as the destination device. If a device for the 
intermediate processing enables at least transmission 
of data, the device can be regarded as the source 
device. If the device for the intermediate processing 
enables at least receipt of data, the same device can be 
regarded as the destination device. Namely any of such 
devices can be regarded as either the source device or 
the destination device. 

[01 29] The applications programs Cyber Copy provide 
options to allow a change of the device, enlargement or 
contraction of the image, and the image correction 
(color correction in this case). For example, when the 
user selects the execution of the enlargement/contrac- 
tion of the image or the image correction in the dis- 
played window of Fig. 18, an image processing server, 
which has been registered in advance as a default, is 
incorporated into the connection. The transfer of image 
data is implemented via the image processing sewer, 
and the image to be copied is subjected to the desired 
processing, such as the enlargemerrt/contraction or the 
color correction, in the image processing server. 
[0130] Fig. 19 shows a flow of Image data. In the 
example of Fig. 19. a scanner B is selected as the 
source device, a printer D as the destination device, and 
an image processing server D as the image processing 
server. Image data are input from the scanner B into the 
image processing server D via a device abstraction unit 
60a, a communications path abstraction unit 62. and a 



device abstraction unit 60c. and are subjected to the 
desired processing in the image processing server D. 
The processed image data are transferred to the printer 
D via the device abstraction unit 60c, a communications 
path abstraction unit 64, and a device abstraction unit 
60b. Although the source device, the destination device, 
and the image processing server are shown as sepa- 
rate elements for the clarity of explanation, the image 
processing server is also a device as described previ- 
ously. Strictly speaking, the image processing server 
functions as the destination device relative to the scan- 
ner and as the source device relative to the printer. 
[0131] The state of communication between the 
devices is displayed in a window on the display means 
as shown in Fig. 18. 

[0132] The user can arbitrarily select the source 
device, the destination device, and the image process- 
ing server. When the user clicks a DEVICE SEL button 
J2 in the displayed window of Fig. 18. a device selection 
tree as shown in Fig. 20 is displayed in a window on the 
display means. The user then freely selects desired 
devices among the options included in the tree. 
[01 33] As described above, the device control system 
of this embodiment readily realizes a virtual copying 
machine as one of the composite devices. 
[01 34] The device control system of the embodiment 
is further described in a concrete manner. Fig. 21 is a 
block diagram illustrating a device control system in the 
state of connection of Fig. 2C. The respective constitu- 
ents shown in Fig. 21 are expressed by different numer- 
als from those allocated to the same constituents shown 
in Figs. 1 ard 2C. ^ — — 
[0135] Referring to Fig. 21, a computer 100 is con- 
nected with a computer 200. to which a printer 240 as a 
destination device is connected, and with a computer 
300. to wNch a scanner 340 as a source device is con- 
nected, via a network (not shown). The computer 100 is 
also directly connected with a monitor 170, which may 
be a CRT or a liquid-crystal display and displays a vari- 
ety of images including a user interface. 
[01 36] The computer 100 includes an application unit 
110. interface units 120 and 140, a user interface (Ul) 
data storage unit 150, an icon data storage unit 160. 
and proxies 180 and 190. The computers 200 and 300 
respectively include stubs 210 and 310. device control- 
lers 220 and 320, and device drivers 230 and 330. 
[01 37] The application unit 1 1 0 is constructed by spe- 
cific applications programs. The applications programs 
include part of the operating system (OS), such as a 
shell displaying a Windows user interface. The interface 
unit 1 20. the proxy 1 80. the stub 210, the device control- 
ler 220. and the device driver 230 are generated corre- 
sponding to the printer 240 or the destination device. 
The interface unit 140. the proxy 190. the stub 310, the 
55 device controller 320. and the device driver 330 are 
generated corresponding to the scanner 340 or the 
source device. 

[01 38] The interface unit 1 20 includes a decision ele- 
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ment 122, a device information menrxjry element 124. a 
user interface (Ul) reference table 128. a data transfer 
execution element 129. an icon reference table 130, a 
data output element 132. a correlation element 134. and 
a determination element 136. The interface unit 140 at 5 
least includes a device information memory element 
144 and a data transfer execution element 148. These 
elements are generated by computer programs. Infor- 
mation pieces 125 and 145 of corresponding device 
classes, information pieces 126 and 146 of compound 10 
operation available device classes, and information 
pieces 127 and 147 of composite device categories are 
stored in advance into the device information memory 
elements 124 and 144. respectively. Information pieces 
of accumulated results 131 and 149 are also accumu- 75 
lated in the device information memory elements 124 
and 144. Such information pieces will be described later 
in detail. 

[0139] Fig. 22 is a block diagram illustrating a hard- 
ware configuration of the computer 100 shown in Fig. so 
21. 

[0140] Referring to Fig. 22. the computer 100 has. as 
the hardware constituents inside or outside thereof, a 
CPU 70 that executes various processes and controls 
according to computer programs, a memory 72 that 25 
stores the computer programs and temporarily registers 
data obtained during the processing, an I/O unit 74 that 
transmits data to and from a variety of peripheral equip- 
ment, a hard disk 76 that stores a variety of data, a com- 
munication unit 78 that may include a modem, a 30 
terminal adapter, and a network card and communi- 
cates with another device via a network, a CD-ROM 
drive 80. a mouse 84 that is used for inputting, for exam- 
ple, user's instructions, and the monitor 170 mentioned 
above. 35 
[0141] As described previously, the respective constit- 
uents included in the application unit 110 and the inter- 
face units 120 and 140 are implemented by the 
computer programs. More concretely, the CPU 70 in the 
computer 100 reads and executes desired computer 40 
programs stored in the memory 72, so as to function as 
the respective constituents. 

[0142] In this embodiment, the computer programs 
stored in the memory 72 are provided in a form 
recorded in the recording medium or the CD-ROM 82 as 45 
discussed previously. The computer programs are read 
by the CD-ROM drive 80 and taken into the computer 
100. The input computer programs are transferred to 
the hard disk 76 and further transferred to the memory 
72. for example, on the activation of the computer 100. so 
Alternatively the input computer programs may be 
transferred to the memory 72 not via the hard disk 76 
but directly. 

[0143] Although the respective constituents included 
in the interface units 120 and 140 are realized by the ss 
software in this embodiment, they may be realized by 
the hardware. 

[0144] The Ul data storage unit 150 and the icon data 
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storage unit 160 are stored in the hard disk 76. 
[0145] The following describes the operations of the 
device control system shown in Rg. 21. It is here 
assumed that the user of the computer 100 desires to 
read an image with the scanner 340 connected to the 
computer 300 and print the input image with the printer 
240 connected to the computer 200. 
[0146] A scanner icon 410, which visually represents 
the scanner 340 as the source device, and a printer icon 
420, which visually represents the printer 240 as the 
destination device, are displayed in a window 400 of the 
monitor 1 70 connected to the computer TOO as shown in 
Fig. 23. The scanner icon 410 is displayed by the inter- 
face unit 140 corresponding to the scanner 340. 
whereas the printer icon 420 is displayed by the inter- 
face unit 120 corresponding to the printer 240. 
[0147] The user of the computer 1 00 first operates the 
mouse 84 connected to the computer 100 and selects 
and drags the scanner icon 410 as the source device 
with a mouse cursor 430 displayed in the window 400. 
The application unit 110 calls the interface unit 140 cor- 
responding to the scanner 340 in response to the 
mouse operation. The user then operates the mouse 84 
and lays the dragged scanner icon 410' upon the printer 
icon 420 as the destination device. The application unit 
110 calls the interface unit 120 corresponding to the 
printer 240 in response to the mouse operation. The 
interface unit 120 corresponding to the printer 240 as 
the destination device is accordingly in charge of a data 
transfer starting process shown in the flowchart of Fig. 
24. 

[0148] Although the interface unit corresponding to 
the destination device is in charge of the processing in 
this embodiment, the principle of the present invention 
is not restricted to this arrangement. The interface unit 
corresponding to the source device may alternatVely be 
in charge of the processing. 

[0149] Rg. 24 is a flowchart showing a data transfer 
starting routine executed by the interface unit 120 
shown in Rg. 21. 

[01 50] The operation of the mouse 84 by the user has 
been transmitted to the interface unit 120 via the appli- 
cation unit 110. When the program enters the data 
transfer starting routine shown in Fig. 24. the con-elation 
element 134 included in the interface unit 120 first cor- 
relates the printer 240, which is the corresponding 
device of the interface unit 120. with a mated device 
based on the transmitted mouse operation at step 
SI 02. The correlation element 134 recognizes that the 
printer 240, which is the con^esponding device of the 
interface unit 120. is a subject of correlation, since the 
application unit 110 has called the interface unit 120. 
The correlation element 134. on the other hand, grasps 
that the mated device to be correlated is the scanner 
340. based on the operation of the mouse 84 transmit- 
ted from the application unit 110. The correlation ele- 
ment 134 accordingly correlates the printer 240 as the 
corresporKJing device with the scanner 340 as the 
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mated device and sends the result of correlation to the 
decision element 122. 

[0151] At subsequent step SI 04. the decision element 
122 obtains information regarding the device classes 
(that is, the device types) of the printer 240 as the corre- 
sponding device and the scanner 340 as the mated 
device from the device information memory element 
124 and the device information memory element 144 of 
the interface unit 1 40 corresponding to the scanner 340, 
based on the input result of correlation. 
[0152] As mentioned previously, the information 
pieces 125 and 145 regarding the corresponding device 
classes are respectively stored in the device information 
memory element 124 and the device information mem- 
ory element 144. The information pieces 125 and 145 
regarding the corresponding device classes represent 
the device classes of the corresponding devices, which 
are the devices respectively corresponding to the inter- 
face units 120 and 140. In a concrete example, the infor- 
mation piece 125 represents 'printer* as the device class 
of the printer 240. whereas the information piece 145 
represents 'scanner* as the device class of the scanner 
340. 

[0153] The decision element 122 accordingly 
accesses to the device information memory element 
124- to obtain the information piece 125 regarding the 
corresponding device class (that is. the device class of 
the printer 240) stored in the device information memory 
element 124. The decision element 122 also accesses 
to the device information memory element 144 to obtain 
the information piece 145 regarding the corresponding 
device class (that is the device class of the scanner 340) 
stored in the device information memory element 144. 
[0154] After grasping that the device class of the 
printer 240 as the corresponding device is 'printer' and 
that the device class of the scanner 340 as the mated 
device is 'scanner, based on the information pieces 1 25 
and 145 thus obtained, the decision element 122 refers 
to the information 126 regarding the compound opera- 
tion available device classes stored in the device infor- 
mation memory element 124 at step S106. The decision 
element 122 then determines whether or not the combi- 
nation of the device classes (the combination of 'printer' 
and 'scanner* in this case) is operable as the composite 
device at step Si 08. 

[01 55] As described previously, the composite device 
represents a virtual device that has at least part of the 
functions of the source device and at least part of the 
functions of the destination device. The devices of inter- 
est are the scanner 340 and the printer 240 in this case, 
so that the composite device is a virtual device having at 
least part of the functions of the scanner 340 and at 
least part of the functions of the printer 240. 
[0156] The virtual composite device specified by a 
certain combination of devices may. however, be inoper- 
able in the actual state. The decision unit 122 accord- 
ingly determines whether or not the virtual composite 
device is actually operable by the processing of steps 



8106 and Si 08 described above. 
[01 57] As described previously. In some combinations 
of arbitrary devices, one arbitrary device may not be 
able to receive and process the data transmitted from 

5 the other arbitrary device. In such cases, the virtual 
composite device is inoperable in the actual state. In 
this emtxdiment, the decision element 122 determines 
whether or not the combination of arbitrary devices is 
operable as the composite device by the processing of 

10 steps SI 06 and SI 08. in order to determine whether or 
not one arbitrary device can receive and process the 
data transmitted from the other arbitrary device. 
[01 58] Instead of determining whether or not the com- 
bination of arbitrary devices Is operable as the compos- 

15 ite device, another technique may be applied to 
determine whether or not one arbitrary device can 
receive and process the data transmitted from the other 
arbitrary device. 

[01 59] As discussed previously, the information pieces 

20 126 and 146 regarding the compound operation availa- 
ble device classes are respectively stored in the device 
information memory elements 124 and 144. The infor- 
mation pieces 1 26 and 1 46 of the compound operation 
available device classes respectively show the device 

25 classes of the other devices that are combined with the 
device classes of the devices corresponding to the inter- 
face units 120 and 140 (the corresponding devices) and 
make the virtual composite devices operable. In a con- 
aete example, the information 126 includes 'scanner', 

30 'digital camera', 'facsimile', and 'electronic mail' as the 
device classes of the other devices that are combined 
with the device dass 'printer' and make the virtual com- 
posite devices operable. The information 146, on the 
other hand, includes 'printer', 'facsimile', and 'electronic 

35 mail' as the device classes of the other devices that are 
combined with the device class 'scanner' and make the 
virtual composite devices operable. 
[0160] The device classes of the other devices that 
are combined with the device class of a specific destina- 

40 tion device are all the device classes of source devices. 
On the contrary, the device classes of the other devices 
that are combined with the device class of a spedfic 
source device are all the device classes of destination 
devices. In the above case, the device classes 'scan- 

45 ner', 'digital camera', 'facsimile', and 'electronic mail' 
that are combined with the device class 'printer* of the 
destination device are all the device classes of source 
devices. The device classes 'printer', 'facsimile', and 
'electronic mail' that are combined with the device class 

50 'scanner' of the source device are all the device classes 
of destination devices. The facsimile and the electronic 
mail function as both the source devices and the desti- 
nation devices, so that the device classes 'facsimile' and 
'electronic mail* belong to the device classes of both the 

55 source devices and destination devices. 

[01 61 ] The decision element 1 22 refers to the informa- 
tion 126 of the compound operation available device 
classes stored in the device information memory ele- 
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ment 124, with respect to the case in which the device 
class 'printer' of the printer 240 as the corresponding 
device is combined with the device class 'scanner* of the 
scanner 340 as the mated device. As mentioned above, 
the device classes 'scanner', 'digital camera', 'facsimile'. 5 
and 'electronic mail' are given in the information 126 as 
the possible options that may be combined with the 
device class 'printer' to implement the operable com- 
posite devices. The decision element 122 accordingly 
determines that the combination of the device class 10 
'printer' with the device class 'scanner' is operable as 
the composite device. After the determination of 
whether the combination is operable as the composite 
device, the decision element 122 transmits the result of 
the determination to the determination element 136. is 
The decision element 122 transfers the other pieces of 
information regarding the mated device or scanner 340. 
that is, the name and the device class, together with the 
result of the determination. 

[0162] In the case where the decision element 122 so 
determines that the combination is operable as the 
composite device, the determination element 136 refers 
to the information 127 of composite device categories 
stored in the device information memory element 124 
and identifies the type of the virtual composite device at 25 
step Si 10. The result of the determination by the deci- 
sion element 122 and the result of the identification by 
the determination element 136 are accumulated as the 
information pieces of accumulated results 131 and 149 
into the device information memory elements 124 and 30 
144. 

[01 63] As described previously, the information pieces 
127 and 147 of composite device categories are stored 
respectively in the device information memory elements 
124 and 144. The information pieces 127 and 147 of 35 
composite device categories represent the types of the 
composite devices (composite device categories) with 
respect to the possible combinations of the device 
classes that are operable as composite devices. In a 
concrete example, the information 127 includes: 40 

'Printer' + 'Scanner' = 'Copying Machine' 
'Scanner* + 'Facsimile' = 'Facsimile (transmitter)' 
'Printer' + 'Facsimile* = 'Facsimile (receiver)' 

45 

[0164] For example, with respect to a specific combi- 
nation of the device class 'printer' with the device class 
'scanner', a copying machine is regarded as the device 
having the functions of both the printer and the scanner. 
The 'copying machine' is accordingly given as the type so 
of the composite device corresponding to the specific 
combination. In another example, with respect to a spe- 
cific combination of the device class 'scanner' with the 
device class 'facsimile', a transmitter facsimile is 
regarded as the device having the functions of both the 55 
scanner and the transmitter portion of the facsimile. The 
'facsimile (transmitter)' is accordingly given as the type 
of the composite device corresponding to the specific 



combination. In still another example, with respect to a 
specific combination of the device class 'printer' with the 
device class 'facsimile', a receiver facsimile is regarded 
as the device having the functions of both the printer 
and the receiver portion of the facsimile. The 'facsimile 
(receiver)' is accordingly given as the type of the com- 
posite device corresponding to the specific combina- 
tion. 

[01 65] The following option is also possible as the 
composite device category: 

'Digital camera' -1- 'Electronic mail' = 'Direct mail 
transmission' 

[0166] With respect to a specific combination of the 
device class 'digital camera' with the device class 'elec- 
tronic mail', direct mail transmission, which enables 
images shot with a digital camera to be directly transmit- 
ted to preset addresses by electronic mail, is regarded 
as the virtual device having the functions of both the dig- 
ital camera and the transmitter portion of the electronic 
mail. The 'direct mail transmission* is accordingly given 
as the type of the composite device corresponding to 
the specific combination. 

[0167] The determination element 136 refers to the 
information 127 of composite device categories stored 
in the device information memory element 124. with 
respect to the combination of the device class 'printer* of 
the prirrter 240 as the corresponding device with the 
device class 'scanner' of the scanner 340 as the mated 
device. As discussed above, with respect to the confibi- 
nation of the device class 'printer' with the device class 
'scanner*, the ^copying machine' is given as the type of 
the composite device. The determination element 136 
accordingly determines the device class category 'cop- 
ying machine' as the type of the composite device cor- 
responding to the combination of the device class 
'printer' with the device class 'scanner*. 
[01 68] The type of the composite device identified by 
the determination element 136 is accumulated as the 
information pieces of accumulated results 131 and 149, 
together with the result of the determination by the deci- 
sion element 122. More concretely, the name of the 
scanner 340 as the mated device, the result of the 
determination that the combination is operable as the 
composite device, and the type of the composite device 
'copying machine* are stored in the information of accu- 
mulated results 131. The name of the printer 240, which 
is the mated device of the scanner 340, the result of the 
determination that the combination is operable as the 
composite device, and the type of the composite device 
'copying machine* are stored in the information of accu- 
mulated results 149. 

[01 69] Referring back to Fig. 23, when the user of the 
computer 100 operates the mouse 84 and drops the 
dragged scanner icon 410' upon the printer icon 420. 
the program proceeds to the processing of step S1 12 
shown in the flowchart of Fig. 24. 
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[0170] The determination element 136 gives an 
instruction to start data transfer to the data transfer exe- 
cution element 129 and the data transfer execution ele- 
ment 148 included in the Interface unit 140 at step 
S1 12. The data transfer execution elements 129 and 5 
1 48 then start the actual process of data transfer at step 
S114. In accordance with a concrete procedure, the 
data transfer execution element 148 transmits the 
instruction of starting data transfer to the stub 310 
included In the separate computer 300 via the proxy 1 90 10 
across the network. The stub 310 further transmits the 
instruction to the device driver 330 via the device con- 
troller 320. The device driver 330 accordingly reads 
data from the scanner 340 and transmits the input data 
to the data transfer execution element 148 included in 75 
the interface unit 140 via the device controller 320, the 
stub 310, and the proxy 190. The data transfer execu- 
tion element 148 further sends the data to the data 
transfer execution element 129 included in the interface 
unit 120 via the application unit 110. The data transfer 20 
execution element 129 sends the data to the stub 210 
included in the separate computer 200 via the proxy 180 
across the network. The stub 210 transmits the data to 
the device driver 230 via the device controller 220. The 
device driver 230 then outputs the data to the printer 25 
240. This procedure accordingly implements the data 
transfer from the scanner 340 to the printer 240. 
[0171] As discussed previously, the proxies 180 and 
190 and the stubs 210 and 310 carry out abstraction of 
the communications paths for connecting the comput- 30 
ers with each other, with respect to the upper constitu- 
ents, that is, the application unit 110 and the interface 
units 120 and 140, in the course of transmission of var- 
ious pieces of control information and data between the 
computers 100 and 200 and between the computers 35 
100 and 300 across the network. Namely the proxies 
180 and 190 and the stubs 210 and 310 apparently 
remove a difference in control procedure, which is 
ascribed to the different types of the interposed commu- 
nication paths, and enable the application unit 110 and 40 
the interface units 1 20 and 1 40 to carry out transmission 
of control information and data without taking into 
account whether the interposed communication path 
connects different computers across the network 
boundary or connects different processes across the 45 
process boundary in an identical computer. 
[01 72] The device controllers 220 and 320 apparently 
remove a difference in control procedure, which is 
ascribed to the different device classes or device types 
of the conresponding devices (that is. the printer 240 in so 
the case of the device controller 220 and the scanner 
340 in the case of the device controller 320), and carry 
out abstraction of the devices (abstraction of the hard- 
ware) with respect to the upper constituerrts. that is. the 
application unit 1 1 0 and the interface units 1 20 and 1 40. ss 
[0173] The processing path via the proxies 180 and 
190 and the stubs 210 and 310 enables the application 
unit 1 10 and the interface units 120 and 140 to set. con- 



trol, and operate the device in a substantially fixed con- 
trol environment irrespective of the location of the 
device, without considering the type of the interposed 
communications path. The processing path via the 
device controllers 220 and 320 also enables the appli- 
cation unit 110 and the interface units 120 and 140 to 
set. control, and operate the device in a substantially 
fixed control environment, without considering the 
device class (device type). 

[0174] When the user of the computer 100 operates 
the mouse 84 and drops the dragged scanner icon 410' 
upon the printer icon 420. the data transfer from the 
scanner 340 to the printer 240 is implemented in the 
above manner. 

[0175] In the event that the decision element 122 
determines that the combination is inoperable as the 
composite device at step S108 in the flowchart of Fig. 
24. on the other hand, the program executes the follow- 
ing process. In accordance with a concrete procedure, 
in the case of the negative answer at step Si 08. the 
determination element 136 gives an instruction to dis- 
play an impossible-correlation mark to the data output 
element 132 at step S1 16. The data output element 1 32 
accordingly displays a predetermined mark represent- 
ing an impossible correlation at a specific position in the 
window on the monitor 170. where the icon correspond- 
ing to the source device is laid upon the icon corre- 
sponding to the destination device. This informs the 
user that the combination of the source device of inter- 
est with the destination device of interest is inoperable 
as the composite device and the correlation is eventu- 
ally unfulfilled. 

[01 76] As described above, when the user of the com- 
puter 100 drags the scanner icon 410 onto the printer 
icon 420. in order to read an image with the scanner 340 
connected to the computer 300 and print the input 
image with the printer 240 connected to the computer 
200. the procedure of the embodiment automatically 
determines whether the combination of the scanner 340 
with the printer 240 is operable as the composite device. 
In the case of the affirmative answer at step SI 08, that 
is. when it is determined that the combination is opera- 
ble as the composite device, it is guaranteed that the 
printer 240 can receive and process the image data 
transmitted from the scanner 340. When the user sub- 
sequently drops the dragged scanner icon 410' upon 
the printer icon 420 to start the actual transfer of the 
image data from the scanner 340 to the printer 240. this 
arrangement of the embodiment ensures the effective 
data transfer between the scanner 340 and the printer 
240. 

[01 77] In the above example, when the dragged scan- 
ner icon 410' is dropped upon the printer icon 420. the 
data transfer from the scanner 340 to the printer 240 
starts immediately. In another example discussed 
below, the data transfer does not start immediately, but 
a user interface is displayed in a window on the monitor 
170 at the moment of dropping the dragged scanner 
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icon 410' upon the printer icon 420. 
[0178] Fig. 25 is a flowchart showing a user interface 
display routine executed by the interface unit 120 shown 
in Fig. 21. 

[0179] The processing of steps S122 through S130 5 
and the processing of step Si 36 in the flowchart of Fig. 
25 are identical with the processing, of steps S102 
through S1 1 0 and the processing of step S1 1 6 shown in 
the flowchart of Rg. 24 aind are thus not specifically 
described here. 70 
[0180] After identifying the type of the composite 
device (that is. determining that the type of the compos- 
ite device is the 'copying machine' in this example) at 
step S130. the determination element 136 refers to the 
Ul reference table 128 and specifies a user interface is 
corresponding to the type of the composite device thus 
determined at step Si 32. The Ul reference table 128 
includes, for example, identification numbers of user 
interfaces corresponding to the respective types of the 
operable composite devices. In accordance with a con- 20 
Crete procedure of step Si 32. the determination ele- 
ment 136 reads the identification number of the user 
interface corresponding to the type of the composite 
device identified at step Si 30 from the Ul reference 
table 128 and transmits the identification number to the 25 
data output element 132. 

[0181] Referring t>ack to Fig. 23; when the user of the 
computer 100 operates the mouse 84 and drops the 
dragged scanner icon 410' upon the printer icon 420. 
the program proceeds to the processing of step Si 34 30 
shown in the flowchart of Fig. 25. 
[0182] The data output element 132 downloads data 
of the corresponding user interface, that is. data 
required to display the corresponding user interface in a 
window on the monitor 170. from the Ul data storage 35 
unit 150. based on the transmitted identification number 
of the corresponding user interface. The Ul data storage 
unit 150 stores data of the user interfaces correspond- 
ing to the respective types of the operable composite 
devices. The user interface corresponding to the type of 40 
the composite device implies the user interface suitable 
for setting, controlling and operating (in a narrow sense) 
the composite device. 

[0183] Since the type of the composite device identi- 
fied by the determination element 136 is the 'copying 45 
machine' in this example, the data output element 132 
selects data of the user interface for operating the copy- 
ing machine among the data of the user interfaces 
stored in the Ul data storage unit 150 and downloads 
the data of the selected user interface. 50 
[0184] The data oulput element 132 subsequently out- 
puts the downloaded data of the user interface to the 
monitor 170 connected to the computer 100 and dis- 
plays the user interface suitable for operating the copy- 
ing machine as the composite device in a window on the 55 
monitor 170 at step S134. 

[0185] In accordance with the above procedure, at the 
moment when the user of the computer 100 operates 



the mouse 84 and drops the dragged scanner icon 410* 
upon the printer icon 420. a user interface for operating 
a copying machine as the composite device as shown in 
Fig. 26 is displayed in a window on the monitor 170 as 
the user interface for operating both the scanner 340 
and the printer 240. 

[0186] In the above example, the type of the cdnnpos- 
ite device is the 'copying machine' specified by the com- 
bination of the device class 'printer' with the device class 
'scanner'. The user interface for operating the copying 
machine as shown in Rg. 26 is thus displayed in a win- 
dow on the monitor 170. In the case of another combi- 
nation of the device class 'printer' with the device class 
'facsimile', the type of the composite device is the 'fac- 
simile' (receiver)', so that another user interface for 
operating a receiver facsimile is displayed in a window 
on the monitor 1 70 as shown in Fig. 27. 
[01 87] As described above, when the user of the com- 
puter 100 desires to read an image with the scanner 
340 connected to the computer 300 and print the input 
image with the printer 240 connected to the computer 
200. a user interface for operating a copying machine 
having the functions of both a printer and a scanner is 
displayed as the user interface for operating both the 
scanner 340 and the printer 240. This arrangement 
does not require different user interfaces for the scanner 
340 and the printer 240 and enables the user to specify 
the required settings simultaneously in a united user 
interface. This accordingly provides the user with the 
optimized operatability. The user regards the combina- 
tion of the scanner 340 and the printer 240 as one com- 
posite device, that is, a copying machine, and integrally 
operates the scanner 340 and the printer 240, This fur- 
ther optimizes the operatability. 

[01 88] In the above example, the user interface is dis- 
played in the window on the monitor 170 at the moment 
when the dragged scanner icon 410' is dropped upon 
the printer icon 420. As discussed below, however, an 
icon con-esponding to the composite device may be dis- 
played prior to the display of the user interface for oper- 
ating the composite device. In this case, in order to 
enable the user to select display or non -display of the 
icon, a typical procedure may detect an operation or 
non-operation of a specific key at the moment of the 
drag and drop operation or may display a menu for 
selecting creation or non-creation of an icon. 
[0189] Fig. 28 is a flowchart showing a modification of 
the user interface display routine of Fig. 25. 
[0190] In this modified procedure, at step S132, the 
determination element 136 refers to the Ul reference 
table 128 and specifies a user interface corresponding 
to the type of the composite device identified at step 
Si 30. At subsequent step S140. the determination ele- 
ment 136 refers to the icon reference table 130 and 
selects an icon corresponding to the type of the com- 
posite device identified at step Si 30. The icon reference 
table 130 stores the identification numbers of icons cor- 
responding to the respective types of the operable com- 
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posite devices. The determination element 136 reads 
the identification number of the icon corresponding to 
the predetermined type of the composite device from 
the icon reference table 130 and transmits the identifica- 
tion number of the icon to the data output element 132. 
[0191] When the user of the computer 100 operates 
the mouse 84 and drops the dragged scanner icon 410' 
upon the printer Icon 420, the program proceeds to the 
processing of and after step S142 shown in the flow- 
chart of Fig. 28. 

[0192] The data output element 132 downloads data 
for displaying the corresponding icon in the window on 
the monitor 170 from the icon data storage unit 160, 
based on the identification number of the icon transmit- 
ted from the determination element 136. The icon data 
storage unit 160 stores the data of icons that visually 
represent the respective types of the operable compos- 
ite devices. 

[0193] In the case where the type of the composite 
device identified by the determination element 136 is 
the 'copying machine*, the data output element 132 
selects the data of the icon corresponding to the copy- 
ing machine among the data of icons stored in the icon 
data storage unit 1 60 and downloads the data of the 
selected icon. 

[01 94] The data output element 1 32 subsequently out- 
puts the downloaded data of the selected icon to the 
monitor 170 connected to the computer 100 and dis- 
plays the icon corresponding to the copying machine as 
the composite device in the window on the monitor 170 
at step S142. 

[01 95] At the moment when the user of the computer 
100 operates the mouse 84 and drops the dragged 
scanner icon 410' upon the printer icon, a copying 
machine icon 440 that visually represents the copying 
machine as the composite device is displayed in the 
window on the monitor 170 as shown in Fig. 29. The 
copying machine icon 440 may be displayed at the posi- 
tion of the drag and drop operation or at a separate 
position like a composite device folder. The scanner 
icon 410 and the printer icon 420 may be eliminated 
tenrporarily from the window on the monitor 170 as 
shown in Fig. 29 or may alternatively be kept in the win- 
dow. 

[0196] The determination element 136 stores a piece 
of information regarding which devices actually consti- 
tute the composite device represented by the displayed 
copying machine icon 440 (that is, a piece of information 
showing that the copying machine as the composite 
device consists of the scanner 340 as the source device 
and the printer 240 as the destination device) into the 
device information memory elements 122 and 144 as 
the information pieces of accumulated results 131 and 
149. The determination element 136 then monitors 
whether or not the user of the computer 100 places the 
mouse cursor 430 on the copying machine icon 440 as 
shown in Fig. 29 and clicks a button on the mouse 84 at 
step Si 44. In response to the detection of a click of the 



mouse 84, the determination element 136 carries out 
the processing of step S134, which has been described 
previously with the flowchart of Fig. 25. 
[01 97] At the moment when the user of the computer 

5 100 clicks a button on the mouse 84 while the mouse 
cursor 430 is placed on the copying machine icon 440, 
the processing of steps S144 and SI 34 causes the user 
interface for operating the copying machine to be dis- 
played in the window on the monitor 1 70 as shown in 

10 Fig. 26. 

[01 98] This modified procedure displays the icon cor- 
responding to the composite device, that is. the copying 
machine, as the icon corresponding to the connbination 
of the scanner 340 and the prirrter 240, which are the 

15 objects of correlation. This enables the user of the com- 
puter 100 to visually recognize the combination of the 
scanner 340 with the printer 240 as one new device, the 
copying machine, and facilitates the subsequent 
processing. While the icon corresponding to the com- 

20 posite device or the copying machine is displayed, the 
user interface for operating the composite device or the 
copying machine is displayed in response to a specified 
instruction of the user. This arrangement enables the 
user to input the required instructions, for example, the 

25 settings of the copying machine, via the user interface. 
[01 99] While the user interface for operating the com- 
posite device, for example, the copying machine, is dis- 
played in the window on the monitor 1 70, when the user 
of the computer 100 inputs the required instructions, for 

30 example, the settings of the composite device, to the 
computer 1 00 via the user interface, the instructions are 
transmitted to the printer 240 connected with the com- 
puter 200 and to the scanner 340 connected with the 
computer 300 according to the process discussed 

35 below. 

[0200] When the user of the computer 100 operates 
the keyboard (not shown) or the mouse 84 and inputs 
the instructions regarding the desired settings of the 
composite device via the user interface displayed in the 
40 window on the monitor 170, the application unit 110 
transmits the instructions regarding the settings of the 
printer 240 to the interface unit 120 and the instructions 
regarding the settings of the scanner 340 to the inter- 
face unit 140. The interface units 120 and 140 respec- 
ts tively transmit the input instructions from the proxies 
180 and 190 to the stubs 210 and 310 in the separate 
computers 200 and 300 across the network. The stubs 
210 and 310 further transmit the instructions to the 
device drivers 230 and 330 via the device controllers 
50 220 and 320. The device driver 230 implements the set- 
tings of the printer 240 in response to the instructions, 
whereas the device driver 330 implements the settings 
of the scanner 340 in response to the instructions. 
[0201 ] As described previously, the result of the deter- 
55 mination by the decision element 122 and the result of 
the identification by the determination element 136 are 
accumulated as the information of accumulated results 
131 into the device information memory element 124 at 



19 



37 



EP0 969 653 A2 



38 



steo S1 10 in the data transfer starting process shown in 
Fig. 24 or at step SI 30 in the user interface display 
process shown in Fig. 25. in the above example, the 
printer 240 as the corresponding device is correlated 
with the scanner 340 as the mated device and the sub- 5 
sequent processing is performed as discussed above. 
Every time another device is correlated with the printer 
240 as the corresponding device, the above processing 
is carried out to accumulate the result of the determina- 
tion and the result of the identification as the information 10 
of accumulated results 131 . The information of accumu- 
lated results 131 accordingly includes the names of all 
the devices that have been correlated with the printer 
240 as the corresponding device in the past, the results 
of the determination of whether or not the respective 15 
combinations of the devices with the printer 240 are 
operable as the composite devices, and the types of the 
operable composite devices. 

[0202] The use of the information of accumulated 
results 131 enables the following operation. The pieces 20 
of information relating to a specific device that has been 
correlated with the printer 240 as the corresponding 
device are stored in the information of accumulated 
results 131 . In the data transfer starting process shown 
in Fig. 24 or in the user interface display process shown 25 
in Fig. 25. the decision element 122 accesses to the 
information of accumulated results 131. in order to 
retrieve the pieces of information regarding the mated 
device, at the time when the name of the mated device 
to be correlated is transmitted from the correlation ele- 30 
ment 134. In the case where the pieces of information 
regarding the mated device are included in the informa- 
tion of accumulated results 131, the decision element 
122 reads the pieces of information regarding the mated 
device. When it has been determined previously that the 35 
combination with the specific mated device is operable 
as the composite device according to the pieces of infor- 
mation, the program skips to step S1 12 in the data 
transfer starting process or to step S132 in the user 
interface display process. The subsequent processing 40 
is based on these pieces of information. When it has 
been determined previously that the combination with 
the specific mated device is inoperable as the compos- 
ite device, on the other hand, the program skips to step 
Si 16 in the data transfer starting process or to step 45 
S136 in the user interface display process. 
[0203] This arrangement omits the processes of refer- 
ence, determination, and identification (the processing 
of steps Si 04 through S1 10 or the processing of steps 
S124 through S130), thereby favorably shortening the so 
processing time. 

[0204] In the case where the information of accumu- 
lated results 131 includes correlation frequency infor- 
mation, which represents the frequency of correlation of 
a specific mated device with the printer 240. after the ss 
series of the processing in the data transfer starting 
process or in the user interface display process is con- 
cluded, the decision element 122 accesses to the infor- 



mation of accumulated results 131 again and updates 
the correlation frequency information regarding the spe- 
cific mated device. A concrete procedure increments 
the frequency of conrelation by one with respect to the 
specific mated device. 

[0205] The use of the Information of accumulated 
results 131 also enables the following operation. Fig. 30 
shows a pop-up menu displayed in the vicinity of the 
printer icon 420 in the window on the nnonitor 1 70 by uti- 
lizing the information of accumulated results 131 shown 
in Fig. 21 . As shown in Fig. 30. while the printer icon 420 
is displayed in the window 400 on the monitor 170, 
when the user operates the mouse 84 to select the 
printer icon 420 with the mouse cursor 430 displayed in 
the window 400 and dick the right button on the mouse 
84, the data output element 132 refers to the informa- 
tion of accumulated results 131 and causes a pop-up 
menu 470 to be displayed in the vicinity of the printer 
icon 420. The pop-up menu 470 includes the names of 
the devices, which have been con-elated with the printer 
240 as the corresponding device in the past and deter- 
mined that their respective combinations with the printer 
240 are operable as composite devices. The names of 
the devices displayed in the pop-up menu 470 are 
arranged in the descending sequence of the frequency 
of correlation with the printer 240, based on the correla- 
tion frequency information stored in the information of 
accumulated results 131 . 

[0206] When the user selects a desired device to be 
correlated with the printer 240 as the corresponding 
device among the displayed device options with the 
mouse cursor 430. the correlation element 134 corre- 
lates the printer 240 as the corresponding device with 
the selected mated device. 

[0207] The display of the pop-up menu enables the 
user to readily grasp the possible device options that 
have been determined to be operable as the composite 
devices with the printer 240 (con-esponding device), as 
well as to obtain the frequency of correlation of the 
respective device options with the printer 240. Since the 
devices having the higher frequencies of conrelation 
with the printer 240 are located at the upper positions, 
the user can immediately select the device that has 
been correlated with the printer 240 most frequently. 
[0208] Fig. 31 shows possible combinations of the 
source device and the destination device displayed in a 
window on the monitor 170 by utilizing the information of 
accumulated results 131 shown in Fig. 21. When the 
user instructs the computer 100 to display possible 
combinations of the source device and the desitination 
device through the operation of the mouse 84, a specific 
interface unit refers to the information of accumulated 
results stored therein and the information of accumu- 
lated results stored in another interface unit, and 
retrieves the combinations of devices that have been 
correlated with each other in the past by means of the 
computer 100 and determined to be operable as the 
composite devices. A combination display window 480 
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is open upon the window 400 on the monitor 1 70 to dis- 
play the results of the retrieval as shown in Fig. 31. 
[0209] The combination display window 480 shows 
the names of the source device and the destination 
device with respect to each combination of the devices 
that have been correlated with each other in the past by 
means of the computer 100 and determined to be oper- 
able as the composite device, together with the latest 
date and time of the correlation. 
[021 0] The user can thus readily grasp which combi- 
nations of devices have been correlated to each other 
by means of the computer 100 and determined to be 
operable as composite devices. 

(021 1] Fig. 32 shows a pop-up menu displayed in the 
vicinity of the copying machine icon 440 in the window 
on the monitor 170 by utilizing the information of accu- 
mulated results 131 shown in Fig. 21. As shown in Fig. 
32. while the copying machine icon 440 that visually 
represents the copying machine as the composite 
device is displayed in the window 400 on the monitor 
1 70. when the user operates the mouse 84 to select the 
copying machine icon 440 with the mouse cursor 430 
dtsplayed in the window 400 and click the right button of 
the fTK>use 84. the data output element 132 refers to the 
intormation of accumulated results 131 and causes a 
pop-up menu 490 to be displayed in the vicinity of the 
copying machine icon 440. The pop-up menu 490 
shows the names of the devices constituting the com- 
posite device (that is. the copying machine) represented 
by the copying machine icon 440. In a concrete exam- 
ple, the name of the scanner 340 (for example, scanner 
C) as the source device and the name of the printer 240 
(for example, printer A) as the destination device are 
displayed in the pop-up menu 490 as the devices consti- 
tuting the composite device. 

[021 2] While an icon representing a specific compos- 
ite device is displayed, even if the user forgets which 
connbination of the devices constructs the specific com- 
posite device, the display of the pop-up menu 490 read- 
ily informs the user of the combination of the devices. 
[021 3] In the embodiment discussed above, the data 
transfer starting process shown in Fig. 24 or the user 
interface display process shown in Fig. 25 is carried out 
by dragging the scanner icon 410 corresponding to the 
scanner 340 as the source device onto the printer icon 
420 corresponding to the printer 240 as the destination 
by the operation of the mouse 84 asshown in Fig. 23. In 
accordance with one possible modification, the data 
transfer starting process or the user interface display 
process may be implemented in the following case, as 
well as in the case where the icon corresponding to the 
source device is dragged onto the icon corresponding to 
the destination device. 

[0214] it is here assumed that a digital camera is 
used, instead of the scanner 340. as the source device 
and that a digital camera icon corresponding to the 
source device and the printer icon 420 corresponding to 
the destination device are displayed in the window 400 



on the monitor 1 70. When the user operates the mouse 
84 to lay the mouse cursor 430 upon the digital camera 
icon and double clicks the button on the mouse 84. a 
window 460 is open as shown in Fig. 33 to display 

5 image icons corresponding to respective image files 
taken into the digital camera When the user selects a 
desired image file to be printed with the printer 240 
among a plurality of image files taken into the digital 
camera and drags an image icon 450 corresponding to 

70 the selected image file onto the printer icon 420. the 
data transfer starting process shown in Fig. 24 or the 
user interface display process shown in Fig. 25 is imple- 
mented. 

[0215] At step SI 02 in the flowchart of Fig. 24 or at 
15 Step S122 in the flowchart of Fig. 25. the correlation ele- 
ment 134 included in the interface unit 120 analyzes the 
operation of the mouse 84 transmitted from the applica- 
tion unit 1 1 0. The analysis shows that the device cam- 
era is the source device that has input the image file of 
20 interest and thereby the mated device to be correlated 
with the printer 240, which is the device corresponding 
to the interface unit 120. The correlation element 134 
accordingly correlates the printer 240 with the digital 
camera. 

25 [0216] In this manner, the data transfer starting proc- 
ess or the user intertace display process may be carried 
out by dragging the icon corresponding to a specific 
piece of information input into the source device onto 
the icon corresponding to the destination device. 
30 [0217] In the above description, the icon correspond- 
ing to the source device (or the icon corresponding to a 
specific piece of information input into the source 
device) is dragged onto the icon corresponding to the 
destination device. The data transfer starting process or 
35 the user interlace display process may, however, be car- 
ried out alternatively by dragging the icon correspond- 
ing to the destination device onto the icon 
corresponding to the source device (or the icon corre- 
sponding to a specific piece of information input into the 
40 source device). 

[0218] Instead of dragging the icon, another possit)le 
procedure selects both the icon corresponding to the 
source device (or the icon corresponding to a specific 
piece of information input into the source device) and 
45 the icon corresponding to the destination device 
through the mouse operation and subsequently selects 
an execution command of the data transfer starting 
process or the user interface display process among the 
options included in a displayed pop-up menu, so as to 
50 implement the selected process. 

[0219] In the configuration of Fig. 21 , the user gives a 
variety of instructions to the application unit 110 in the 
computer 100 by operating the mouse 84 connected to 
the computer 1 00. The principle of the present invention 
55 is. however, not restricted to this configuration. For 
example, a variety of instructions may be given to the 
application unit 1 10 in the computer 100 via a network 
with an information terminal, such as a PDA (personal 
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digital assis*=-tt) module, a cellular phone, and a mobile 
computer. 

[0220] F;<: i is a block diagram showing a configura- 
tion in the case that an instruction is given to the appli- 
cation unit 110 of the computer 100 by utilizing an 5 
information terminal 500. The constituents in the struc- 
ture of Fig. 34 that are identical with those in the struc- 
ture of Fig. 21 are expressed by the same numerals. 
[0221] Referring to Fig, 34, the computer 100 is con 
nected with the information terminal 500 via a network io 
(not shown), as well as with the computers 200 and 300. 
The computer 100 includes a public information unit 
195. in addition to the application unit 110. the interface 
units 120 and 140. and the proxies 180 and 190. The 
information terminal 500 includes a remote application 75 
unit 510. an operation unit 520. and a display unit 530. 
[0222] The public information unit 195 in the computer 
100 is constructed, for example, by a Web server soft- 
ware, whereas the remote application unit 510 in the 
information terminal 500 is constructed, for exanple. by 20 
a Web browser software. 

[0223] The public information unit 195 opens the infor- 
mation possessed by the application unit 1 10 to the net- 
work by the Web. When the user of the information 
terminal 500 operates the operation unit 520 and inputs 25 
an URL {Uniform Resource Locator) of the computer 
100. for example. 'http://123.45.67.89/resource\ the 
remote application unit 510 accesses to the computer 
100 based on the input URL, obtains information 
opened to the network by the public information unit 30 
195, and causes the obtained information to be dis- 
played in the display unit 530. As is known to those 
skilled in the art, HTTP, which is the Web standard pro- 
tocol, is applied for transmission of information between 
the computer 100 that is a Web server and the informa- 35 
Won terminal 500 that is a Web client. 
[0224] Fig. 35 shows the appearance of the informa- 
tion terminal 500 shown in Fig. 34 and an exemplified 
window displayed in the display unit 530 of the informa- 
tion terminal 500. The information opened to the net- 40 
work by the public information unit 195 of the computer 
100 is displayed in the form of a home page in the dis- 
play unit 530 of the information terminal 500 as shown 
in Fig. 35. 

[0225] In the example of Fig, 35, the user of the infor- 45 
mation terminal 500 operates the operation unit 520. 
selects either one of the options displayed in a first dis- 
play area 532, that is. 'Source Device' and 'Destination 
Device*, and presses a Search button 534. The possible 
candidates of the selected device are then displayed in so 
a second display area 536. 

[0226] In the event that the user of the information ter- 
minal 500 operates the operation unit 520 and respec- 
tively selects 'Scanner V and Printer V as tiie desired 
source device and destination devices among the dis- 55 
played options, the result of the selection is displayed in 
the second display area 538 as shown in Rg. 35. When 
the user further presses an execution button 'Do' 538, 



42 

the remote application unit 510 gives an instruction of 
starting data transfer from the Scanner 1 to the Printer 1 
to the application unit 1 1 0 via the network and the public 
information unit 195. The application unit 110 further 
transfers the instruction to the interface unit 120, which 
accordingly starts the data transfer starting process 
shown In Fig. 24. 

[0227] This configuration allows instructions to be 
given from the Information terminal to the application 
unit via the network, thereby enabling the information 
terminal with poor resource to control a variety of 
devices on the network. 

[0228] In the configuration of Fig. 21, the Information 
on the devices like the printer 240 and the scanner 340, 
that is. the information pieces 125 and 145 regarding 
the corresponding device classes, the information 
pieces 126 and 146 regarding the compound operation 
available device classes, the information pieces 127 
and 147 regarding the composite device categories, 
and the information pieces of accumulated results 131 
and 149 are stored in the device information memory 
elements 124 and 144 included In the interface units 
120 and 140. The pieces of Information on the devices 
like the printer 240 and the scanner 340 are also stored 
in the device controllers 220 and 320 corresponding to 
the respective devices 240 and 340. It is. however, 
required to store the Information pieces of accumulated 
results 131 and 149 as Independent operations. 
Another possible configuration accordingly does not 
Incorporate the Information on the devices like the 
printer 240 and the scanner 340 in the interface units 
1 20 and 1 40. but accesses to the device controllers 220 
and 320 via the network according to the requirements, 
so as to obtain the information regarding the devices 
like the printer 240 and the scanner 340. Still another 
possible configuration stores the Information regarding 
the devices like the printer 240 and the scanner 340 into 
a separate computer, for example, a server, on the net- 
work other than the computers 100 through 300, and 
accesses to the separate computer via the network to 
obtain the information according to the requirements. 
[0229] In the configuration of Fig. 21, the data of the 
user interfaces and the data of the Icons are stored in 
the Ul data storage unit 150 and the Icon data storage 
unit 160. which are separate from the interface unit 120. 
and downloaded from the corresponding storage units 
to be displayed in the window on the monitor 1 70. The 
principle of the present Invention is. however, not 
restricted to this configuration. For example, the data of 
the user Interfaces and the data of the icons may be 
Incorporated in the interface unit 1 20 that is constructed 
as the COM object. Alternatively the data of the user 
interfaces and the data of the icons may be stored in the 
computer 200 or 300 or a separate computer, for exam- 
ple, a server, on the network other than the computers 
100 through 300. 

[0230] The device control system shown in Fig. 21 has 
the state of connection shown in Fig. 2C. Namely the 
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devices like the printer 240 and the scanner 340 are 
connected to the computers 200 and 300, which are 
separate from the computer 100 including the applica- 
tion unit 110 and the interface units 120 and 140. In a 
different state of connection as shown in Rg. 2B, one of 
the devices like the printer 240 and the scanner 340 
may be connected to the computer 100 including the 
application unit 110. whereas the other device is con- 
nected to a separate computer, for example, the compu- 
ter 200. In the latter state, the constituents of the 
separate computer, for example, the computer 300, that 
is, the stub, the device controller, and the device driver, 
are also generated in the computer 100 including the 
application unit 1 10. In the configuration of Fig. 21. the 
devices like the printer 240 and the scanner 340 are 
externally connected to the computers 200 and 300. As 
shown in Figs. 3A through 3C, the device and the com- 
puter may be integrated with each other. 
[0231] The present invention is not restricted to the 
above embodiment or its modifications, but there may 
be many other modifications, changes, and alterations 
without departing from the scope or spirit of the main 
characteristics of the present invention. 
[0232] In the embodiment discussed above, the 
processing routine refers to the pieces of information 
with regard to the types of the devices included in the 
attribute information of the devices of interest, such as 
the pieces of information 1 25 and 1 45 regarding the cor- 
responding device classes and the pieces of informa- 
tion 126 and 146 regarding the compound operation 
available device classes shown in Fig. 21, and deter- 
mines whether or not the combination of the devices of 
the interest is operable as a conposite device (see 
steps S108 in the flowchart of Fig. 24 or step S128 in 
the flowchart of Rg. 25). As mentioned previously, how- 
ever, the attribute information referred to by the interface 
units 22a and 22b includes various pieces of informa- 
tion other than the type of the device, for example, a 
piece of information for specifying either a source 
device or a destination device, a piece of information for 
specifying either a push type or a pull type (that is. either 
the source side or the destination side is mainly respon- 
sible for the data transfer), the processible data formats, 
the state of the device (for example, operable or not), 
the performance of the device (for example, the 
processing speed), the location of the device (for exam- 
ple, the section and the floor), the processing cost (for 
example, the communication cost and the printing cost) 
of the device, and the presence or non-presence of a 
support for a special data transfer method. 
[0233] In accordance with one modified application, 
after the determination of whether or not the combina- 
tion of the devices of interest is operable as the compos- 
ite device, the procedure may comprehensively 
estimate the degree of effectiveness with respect to the 
combination of the devices of interest, which has been 
determined to be operable as the composite device, 
based on the attribute information and obtain an evalu- 



ation value representing the degree of effectiveness. By 
way of example, the procedure may previously allocate 
weighted points to the respective pieces of the attribute 
information and calculate the total point with respect to 
5 the combination of the devices of interest, so as to 
obtain the evaluation value. 

[0234] The evaluation value may be displayed in the 
vicinity of the icon representing the device of interest in 
the window 400 on the monitor 1 70. 

10 [0235] In the case where a plurality of mated devices 
are selected for a certain corresponding device to make 
plural combinations of devices of interest, the procedure 
may obtain evaluation values with regard to the respec- 
tive combinations and display a list of the mated devices 

75 in the descending sequence of the evaluation value. 
[0236] Fig. 36 is a flowchart showing another user 
interface display routine executed by the interface unit 
120 shown in Rg. 21. 

[0237] Referring to Fig. 36, when the decision element 
20 122 determines that the combination of the devices of 
interest is operable as the composite device at step 
SI 48, the determination element 136 identifies the type 
of the composite device at step SI 50 and subsequently 
refers to the attribute information stored in the device 
25 information memory element 1 22 or 1 44 to calculate the 
evaluation value representing the degree of effective- 
ness with respect to the combination of the devices of 
interest at step SI 52. The data output element 132 then 
gives the display as described above in the window 400 
30 on the monitor 170, based on the calculated evaluation 
value at step SI 54. 

[0238] In the above embodiment, either two devices or 
three devices are the objects to be controlled. The prin- 
ciple of the present invention is, however, not restricted 
35 to such arrangements, but four or more devices may be 
set as the objects to be controlled. 
[0239] The scope and spirit of the present invention 
are limited only by the terms of the appended daims. 

40 Claims 

1 . A device control apparatus that enables control of a 
source device, which is a transmitter of data, and a 
destination device, which is a receiver of data, said 

45 device control apparatus comprising: 

a device specification unit that specifies a 
source device and a destination device; and 
a decision unit that determines whether or not 
50 the specified destination device can receive 

and process data transmitted from the speci- 
fied source device, based on attribute informa- 
tion of the specified source device and the 
specified destination device. 

55 

2. A device control apparatus in accordance with 
claim 1 , said device control apparatus further com- 
prising: 
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a user interface specification unit that, when 
said decision unit determines that the specified 
destination device can receive and process 
data transmitted from the specified source 
device, specifies a user interface for operating 5 
a composite device, which has both at least 
part of functions of the specified source device 
and at least part of functions of the specified 
destination device, as a user interface for oper- 
ating both the specified source device and the 10 
specified destination device; and 
a display control unit that causes the user inter- 
face specified by said user interface specifica- 
tion unit to be displayed on a display unit. 

15 

3. A device control apparatus in accordance with 
claim 2, wherein said display control unit com- 
prises: 

a data storage unit that stores data required to 20 
cause user interfaces for respectively operating 
a plurality of the composite devices to be dis- 
played on said display unit; and 
a data output unit that reads specific data 
regarding the user interface specified by said 25 
yser interface specification unit from said data 
storage unit and outputs the specific data to 
said display unit. 

4. A device control apparatus in accordance with 30 
claim 1 . said device control apparatus further com- 
prising: 

a symbol specification unit that, when said 
decision unit determines that the specified des- 35 
tination device can receive and process data 
transmitted from the specified source device, 
specifies a symbol corresponding to a compos- 
ite device, which has both at least part of func- 
tions of the specified source device and at least 40 
part of functions of the specified destination 
device, as a symbol corresponding to a combi- 
nation of the specified source device with the 
specified destination device; and 
a display control unit that causes the symbol 45 
specified by said symbol specification unit to be 
displayed on a display unit. 

5. A device control apparatus in accordance with 
claim 4. said device control apparatus further com- so 
prising: 

a user interface specification unit that, when 
said decision unit determines that the specified 
destination device can receive and process 55 
data transmitted from the specified source 
device, specifies a user interface for operating 
the composite device as a user interface for 



operating both the specified source device and 
the specified destination device, 
wherein said display control unit causes the 
user interface specified by said user interface 
specification unit to be displayed on said dis- 
play unit, when a predetermined operation is 
performed with respect to the specified symbol 
that is being displayed on said display unit. 

6. A device control apparatus in accordance with 
claim 4, said device control apparatus further com- 
prising: 

a memory unit that stores data representing 
the combination of the specified source device 
with the specified destination device, with 
regard to the symbol specified by said symbol 
specification unit. 

wherein said display control unit refers to the 
data stored in said memory unit and causes the 
combination of the specified source device with 
the specified destination device corresponding 
to the specified symbol to be displayed on said 
display unit, when a predetermined operation is 
performed with respect to the specified symbol 
that is being displayed on said display unit. 

7. A device control apparatus in accordance with 
either one of claims 2 and 4. wherein said decision 
unit determines whether or not a combination of a 
type of the specified source device with a type of 
the specified destination device is operable as the 
composite device, so as to determine whether or 
not the specified destination device can receive and 
process the data transmitted from the specified 
source device. 

8. A device control apparatus in accordance with 
claim 1. said device control apparatus further com- 
prising: 

a data transfer execution unit that, when said 
decision unit determines that the specified des- 
tination device can receive and process data 
transmitted from the specified source device, 
controls the specified source device and the 
specified destination device, in order to enable 
data to be transferred from the specified source 
device to the specified destination device viia 
said device control apparatus. 

9. A device control apparatus in accordance with 
claim 1 , said device control apparatus further com- 
prising: 

a data transfer execution unit that, when said 
decision unit determines that the specified des- 
tination device can receive and process data 
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transmitted from the specified source device, 
controls the specified source device and the 
specified destination device, in order to enable 
data to be transferred from the specified source 
device to the specified destination device not 5 
via said device control apparatus. 

10. A device control apparatus in accordance with 
claim 1, wherein the attribute information is stored 

in at least one of said device control apparatus, an 10 
apparatus including each of the devices, an appara- 
tus connected to each of the devices, and an appa- 
ratus connected to said device control apparatus 
and each of the devices via a network. 

15 

11. A device control apparatus in accordance with 
claim 1 . wherein the attribute information includes a 
piece of information regarding a type of each 
device. 

20 

12. A device control apparatus in accordance with 
claim 1 , wherein the attribute information includes a 
piece of information regarding a data format 
processible by each device. 

25 

13. A device control apparatus in accordance with 
claim 1. wherein said decision unit specifies a 
degree of effectiveness with regard to a combina- 
tion of the specified source device with the speci- 
fied destination device, based on the attribute 30 
information of the specified source device and the 
specified destination device, when determining that 
the specified destination device can receive and 
process the data transmitted from the specified 
source device. 35 

14. A device control apparatus in accordance with 
claim 1, wherein at least one of the source device 
and the destination device is connected to said 
device control apparatus via a network. 40 

15. A device controi apparatus in accordance with 
claim 1 . wherein at least one of the source device 
and the destination device is constructed integrally 
with at least either one of said device control appa- 45 
ratus and an apparatus connected to said device 
control apparatus via a network. 

16. A device control apparatus in accordance with 
claim 1 . wherein said device specif ication unit spec- so 
ifies at least three devices as a total of the source 
device and the destination device. 

17. A device control apparatus in accordance with 
claim 1 . wherein said device specification unit spec- ss 
ifies the source device and the destination device, 
when a predetermined operation is performed with 
respect to both a symbol corresponding to the 



source device and a symbol corresponding to the 
destination device while tx)th the symbols are dis- 
played on a display unit. 

18. A device control apparatus in accordance with 
claim 1, wherein said device specification unit spec- 
ifies the source device and the destination device, 

. when a predetermined operation is performed with 
respect to both a symbol corresponding to data 
transmissible from the source device and a symbol 
corresponding to the destination device while both 
the symbols are displayed on a display unit 

19. A device control apparatus in accordance with 
claim 1, said device control apparatus further com- 
prising: 

a memory unit that stores a result of the deter- 
mination carried out by said decision unit with 
respect to the specified source device and the 
specified destination device. 

20. A device control apparatus in accordance with 
claim 19. said device control apparatus further 
comprising: 

a display control unit that causes a symbol cor- 
responding to either one of the source device 
and the destination device to be displayed on a 
display unit, 

wherein said display control unit refers to the 
result of the determination stored in said mem- 
ory unit and causes a list of mated devices, 
which may be combined with the device 
expressed by the symbol and have been deter- 
mined affirmatively in the past by said decision 
unit, to be displayed on said display unit, when 
a predetermined operation is performed with 
respect to the symbol that is being displayed. 

21. A device control apparatus in accordance with 
claim 19. said device control apparatus further 
comprising: 

a display control unit that refers to the result of 
the determination stored in said memory unit 
and causes a list of combinations of the source 
device and the destination device, which have 
been determined affirmatively in the past by 
said decision unit, to be displayed on a display 
unit. 

22. A device control apparatus in accordance with 
claim 1 . wherein said device specification unit spec- 
ifies the source device and the destination device in 
response to a specific instruction transmitted via a 
network from a certain apparatus, which is con- 
nected with said device control apparatus via the 
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network. 

23. A device control apparatus in accordance with 
claim 22, said device control apparatus further 
comprising a public information unit that opens s 
information, which is utilized for obtaining the spe- 
cific instruction, via the network to said certain 
apparatus that is connected with said device control 
apparatus via the network. 

10 

24. A remote instruction apparatus connected to a 
device control apparatus that enables control of a 
source device, which is a transmitter of data, and a 
destination device, which is a receiver of data, via a 
network, said device control apparatus comprising: 75 

a device specification unit that specifies a 
source device and a destination device; and 
a decision unit that determines whether or not 
the specified destination device can receive 20 
and process data transmitted from the speci- 
fied source device, based on attribute informa- 
tion of the specified source device and the 
specified destination device. 

said remote instruction apparatus transmitting 25 
a specific instruction, which causes said device 
specification unit to specify the source device 
and the destination device, via the network. 

25. A device control system comprising a source 30 
device, which is a transmitter of data, a destination 
device, which is a receiver of data, and a device 
control apparatus that enables control of the source 
device and the destination device, 

wherein said device control apparatus comprises: 35 

a device specification unit that specifies a 
source device and a destination device; and 
a decision unit that determines whether or not 
the specified destination device can receive 40 
and process data transmitted from the speci- 
fied source device, based on attribute informa- 
tion of the specified source device and the 
specified destination device. 

45 

26. A method of determining a combination of a source 
device, which is a transmitter of data, with a desti- 
nation device, which is a receiver of data, said 
method comprising the steps of: 

so 

(a) specifying a source device and a destina- 
tion device; and 

(b) determining whether or not the specified 
destination device can receive and process 
data transmitted from the specified source 55 
device, based on attribute information of the 
specified source device and the specified des- 
tination device. 



27. A method in accordance with claim 26, said method 
further comprising the steps of: 

(c) when it is determined in said step (b) that 
the specified destination device can receive 
and process data transmitted from the speci- 
fied source device, specifying a user interface 
for operating a composite device, which has 
both at least part of functions of the specified 
source device and at least part of functions of 
the specified destination device, as a user 
Interface for operating both the specified 
source device and the specified destination 
device; and 

(d) causing the user interface specified in said 
step (c) to be displayed. 

28. A method in accordance with claim 26, said method 
further comprising the step of: 

(c) when it is determined in said step (b) that 
the specified destination device can receive 
and process data transmitted from the speci- 
fied source device, controlling the specified 
source device and the specified destination 
device, in order to enable data to be transferred 
from the specified source device to the speci- 
fied destination device via a device control 
apparatus that enables control of the source 
device and the destination device. 

29. A method in accordance with claim 26, said method 
further comprising the step of: 

(c) when it is determined in said step (b) that 
the specified destination device can receive 
and process data transmitted from the speci- 
fied source device, controlling the specified 
source device and the specified destination 
device, in order to enable data to be transferred 
from the specified source device to the speci- 
fied destination device not via a device control 
apparatus that enables control of the source 
device and the destination device. 

30. A method in accordance with claim 26. wherein 
said step (a) comprises the steps of: 

(a-1) causing a symbol corresponding to the 
source device and a symbol corresponding to 
the destination device to be displayed; and 
(a-2) when a predetermined operation is per- 
formed with respect to both the symbols, spec- 
ifying the source device and the destination 
device. 

31. A computer program comprising a program code 
that executes said method in accordance with any 
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one of claims 26 through 30. 

32. A computer readable medium in which said compu- 
ter program in accordance with claim 31 Is 
recorded. s 

33, A data signal that comprises said computer pro- 
gram in accordance with claim 31 ar»d is embodied 
in a carrier. 
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